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ABSTRACT 


Using  limited  resources,  a  network  interdictor  attempts  to  disable  components  of  a 
capacitated  network  with  the  objective  of  minimizing  the  maximum  network  flow 
achievable  by  the  network  user.  This  problem  has  applications  to  reducing  the  importation 
of  illegal  drugs  and  planning  wartime  air  attacks  against  an  enemy's  supply  lines.  A 
deterministic  model  using  Benders  decomposition  is  developed  and  improved  upon  with 
an  original  "flow-dispersion  heuristic."  An  extension  is  made  to  accommodate 
probabilistic  scenarios,  where  each  scenario  is  an  estimate  of  uncertain  arc  capacities  in 
the  actual  netwoik.  A  unique  sequential-approximation  algorithm  is  utilized  to  investigate 
cases  where  interdiction  successes  are  binary  random  variables. 

For  a  network  of  3200  nodes  and  6280  arcs.  Benders  decomposition  solves  the 
network  interdiction  problem  in  less  than  one-third  of  the  time  required  by  a  direct  branch- 
and-bound  method.  The  flow-dispersion  heuristic  can  decrease  solution  time  to  one-fifth 
or  less  of  that  required  for  the  Benders  decomposition  algorithm  alone.  With  six  allowable 
but  uncertain  interdictions  in  a  network  of  100  nodes  and  84  possible  interdiction  sites 
among  180  arcs,  a  stochastic  network  interdiction  problem  is  solved  to  optimality  in  24 
minutes  on  a  IBM  RISC/6000  Model  590.  With  uncertain  arc  capacities  in  five  scenarios, 
and  three  allowable  and  certain  interdictions,  a  900  node  and  1740  arc  network  is  solved 
to  optimality  in  17  minutes  on  a  60MHZ  Pentium  PC. 
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THESIS  DISCLAIMER 


The  reader  is  cautioned  that  the  computer  programs  developed  in  this  research  may  not 
have  been  exercised  for  all  cases  of  interest.  While  every  effort  has  been  made,  within  the 
time  available,  to  ensure  that  the  programs  are  free  of  computational  and  logic  errors,  they 
cannot  be  considered  validated.  Any  application  of  these  programs  without  additional 
verification  is  at  the  risk  of  the  user. 
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EXECUTIVE  SUMMARY 


This  thesis  develops  new  mathematical  methods  for  the  effective  employment  of 
limited  resources  to  reduce  the  undesirable  flow  of  a  commodity  that  can  be  moved 
through  a  capacitated  transportation  system  by  an  adversary.  Typically,  this  commodity  is 
moved  along  routes  made  up  of  many  shorter  interconnected  segments,  or  links,  giving  the 
adversary  flexibility  to  select  a  variety  of  transportation  routes  from  one  or  more  initial 
sources  to  one  or  more  ultimate  destinations.  If  information  can  be  obtained  about  these 
routes,  a  mathematical  model  of  the  transportation  system  can  be  constructed  and 
represented  as  a  network  of  junctions  and  links  between  the  junctions.  Each  link  (and 
possibly,  each  junction)  has  a  capacity,  i.e.,  an  upper  limit  on  how  much  of  the  commodity 
it  can  accommodate  in  a  given  time  period.  By  expending  resources  on  a  link  or  junction 
in  the  network,  an  interdictor  may  stop,  or  interdict,  all  flow  of  the  commodity  on  that  link 
or  junction.  Given  a  limited  budget  for  resources  that  can  operate  on  the  network,  the 
interdictor  can  analyze  the  network  to  determine  the  best  interdiction  locations  to  achieve 
the  greatest  reduction  in  the  flow  of  the  commodity. 

This  network  interdiction  problem  has  applications  to  curbing  the  importation  of 
illegal  drugs,  disrupting  an  illegitimate  communications  network,  or  wartime  air  attacks 
against  an  enemy's  supply  lines.  This  problem  has  been  studied  before,  especially  during 
the  Vietnam  War  effort.  These  existing  works,  however,  tend  to  be  specific  to  the 
application  and  not  easily  adaptable  to  variations  and  enhancements.  More  recently 
developed  techniques,  while  offering  many  advantages  over  the  methods  used  previously, 
may  still  have  difficulty  solving  a  large-scale  network  interdiction  problem  in  a  reasonable 
period  of  time. 

Using  the  well-known  technique  of  Benders  decomposition,  this  thesis  addresses  this 
shortcoming  by  developing  a  solution  by  separating  the  network  interdiction  problem  into 
several  smaller  problems,  which  when  solved  sequentially,  solve  the  original  problem.  The 
nature  of  this  decomposition  technique  allows  the  observation  of  both  lower  and  upper 
bounds  on  the  optimal  solution  while  the  problem  is  being  solved. 
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The  decomposition  algorithm  may  be  viewed  as  a  sequence  of  actions  and  reactions 
between  the  interdictor  and  the  adversary.  The  interdictor  can  be  thought  of  as  reacting  to 
the  adversaiy's  rerouting  of  flow  subject  to  a  previous  interdiction  decision.  Therefore, 
we  can  enhance  the  decomposition  algorithm  by  requiring  the  adversary  to  maximize  flow 
while  simultaneously  keeping  flow  on  any  individual  link  or  junction  as  small  as  possible. 
This  allows  the  interdictor  to  gain  more  information  about  which  links  or  junctions  are  the 
most  important,  helping  to  reduce  the  time  required  to  obtain  a  solution. 

This  research  also  explores  the  effects  of  uncertainty  on  the  network  interdiction 
problem.  One  study  of  uncertainty  considers  the  implications  of  links  with  variable 
capacity.  This  study  also  considers  the  possibility  that  a  given  link  is  not,  in  fact,  present 
in  the  network.  Another  study  employs  a  unique  method  to  investigate  the  effect  of 
incorporating  interdictions  that  may  fail  at  certain  locations  in  the  network.  Either  the 
interdiction  attempt  is  completely  successful  at  stopping  flow  in  that  location,  or  it  is 
entirely  unsuccessful. 

The  usefulness  of  the  decomposition  technique  is  undisputed  as  a  viable  alternative 
for  solving  large-scale  network  interdiction  problems.  Two  example  cases  show  dramatic 
improvements  in  the  time  required  to  obtain  a  near-optimal  solution.  The  enhancement 
procedure  to  aid  in  decreasing  the  number  of  interdictor-adversary  actions  and  reactions 
also  produces,  in  most  cases,  further  reductions  in  solution  time. 
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1.  INTRODUCTION 


This  thesis  develops  new  mathematical  programming  methods  for  the  effective 
employment  of  limited  interdiction  assets  to  reduce  the  flow  of  a  commodity  that  can  be 
moved  through  a  capacitated  transportation  system.  An  adversary  strives  to  maximize 
flow  of  the  commodity  through  the  system,  represented  as  a  network,  while  an  interdictor, 
with  limited  assets,  attempts  to  interdict  (destroy)  arcs  or  links  in  the  network  to  minimize 
the  maximum  flow.  While  this  thesis  is  motivated  by  the  ongoing  effort  to  curb  the 
importation  of  illegal  drugs,  many  other  applications  of  these  methods  exist.  Some  other 
uses  may  include  disrupting  an  illegitimate  communications  network  or  wartime  air  attacks 
against  an  enemy's  supply  lines.  The  primary  solution  methodologies  employ  Benders 
decomposition  for  both  deterministic  and  stochastic  models.  The  stochastic  programming 
models  incorporate  scenarios  and  approximation  techniques  to  examine  the  effects  of 
uncertainty  with  respect  to  network  topology,  capacities,  or  success  of  interdiction. 

A.  BACKGROUND 

The  familiar  war  on  drugs  is  a  war  on  two  fronts,  supply  and  demand.  From  the 
moment  anti-drug  efforts  first  became  a  serious  public  issue,  the  debate  has  raged  over 
which  front  deserves  most  attention.  Without  engaging  in  this  debate,  the  focus  here  is  on 
methods  to  reduce  the  supply  of  illegal  drugs  transported  into  the  United  States  from 
abroad.  These  drugs  are  typically  moved  along  routes  made  up  of  many  shorter 
interconnected  segments,  giving  the  drug  trafficker  flexibility  to  select  the  complete 
transportation  route  from  initial  source  to  ultimate  destination.  If  planners  can  obtain 
information  about  these  routes,  a  mathematical  model  of  the  drug  transportation  system 
can  be  constructed  and  represented  as  a  capacitated  network.  Given  a  limited  budget  for 
anti-drug  resources  that  operate  on  the  network,  e.g.,  ground  inspection  teams, 
surveillance  aircraft,  etc.,  planners  can  analyze  the  network  to  determine  where  best  to 
expend  this  budget  to  achieve  the  greatest  reduction  in  illegal  drug  flow  into  the  United 
States. 

The  network  interdiction  problem  is  addressed  from  the  viewpoint  of  a  network 
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interdictor.  From  this  stance,  an  interdictor  observes  a  network  user  striving  to  move  as 
much  commodity  as  possible  from  an  origination  point  to  a  destination  point.  A  network 
interdictor  is  also  aware  of  a  network  user's  ability  to  reroute  flow  around  an  interdiction 
site  in  the  network.  Under  these  conditions,  an  interdictor  works  to  reduce  the 
undesirable  outcome  of  a  user  achieving  a  large  flow  of  commodity  through  the  network. 
Specifically,  a  network  interdictor  attempts  to  minimize  the  maximum  flow  in  the  network 
subject  to  his  limited  supply  of  interdiction  resources,  as  each  interdiction  demands  a 
resource  expenditure  at  the  interdiction  site.  Therefore,  an  interdictor  must  make  the  best 
decisions  possible  about  where  to  apply  his  resources.  A  network  user  has  no  reprisal;  he 
endeavors  to  produce  his  best  flow  results  while  constrained  by  the  destructive  efforts  of 
the  interdictor  and  the  capacity  of  the  network. 

This  problem  and  many  variants  have  been  studied  by  others  under  various  labels. 
These  range  from  the  very  general,  for  example,  "Removing  Arcs  from  a  Network"  by 
Wollmer  (1964),  to  the  very  specific,  such  as,  "Algorithm  for  Targeting  Strikes  in  a  Lines- 
of-Communications  Network,"  also  by  Wollmer  (1970).  Other  contributors  address 
similar  topics  under  other  titles,  but  almost  all  these  works  share  the  common 
characteristic  of  being  specific  to  the  application  and  not  easily  generalizable.  Two  recent 
works  by  Steinrauf  (1991)  and  Wood  (1993)  overcome  this  limitation  by  adopting  a 
mathematical  programming  approach  that  readily  generalizes  and  is  easily  adaptable  to  a 
variety  of  network  interdiction  applications.  These  mathematical  models,  however,  are 
difficult-to-solve  integer  and  mixed  integer  programs.  Wood  shows  that  the  basic 
network  interdiction  problem  is  NP -complete,  even  when  restricted  to  planar  graphs 
where  interdictions  require  varying  amounts  of  resource,  or  to  non-planar  graphs  requiring 
only  one  unit  of  resource  per  arc. 

Advocating  the  advantages  of  a  generalizable  approach,  this  thesis  develops  new 
mathematical  programming  techniques  for  the  network  interdiction  problem  that  offer 
significant  advantages  over  earlier  methods  by  splitting  a  difficult-to-solve  problem  into  a 
sequence  of  several,  more  manageable  problems  that  are  easier  to  solve.  Finally,  and 
perhaps  most  significantly,  this  thesis  begins  to  explore  the  implications  of  uncertainty  in 
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network  interdiction. 

B.  NETWORKS  AND  INTERDICTION 

1,  Description  of  a  Network 

A  directed  network,  denoted  G  =  {N,A),  has  node  set  N  and  arc  set  The  total 
number  of  nodes  and  arcs  in  a  network  is  denoted  |7V|  and  IA\,  respectively.  An  arc  is  an 
ordered  pair  (ij)  with  i,j  eN.  For  an  arc  (ij),  i  is  the  "tail  node"  from  which  the  arc 
originates,  andy  is  the  "head  node"  at  which  the  arc  terminates.  It  is  assumed  that  G 
contains  no  arcs  of  the  form  (/,/).  In  a  transportation  network,  an  arc  (/j)  can  be  thought 
of  as  a  length  of  roadway  or  a  river  segment  that  provides  a  path  for  the  flow  of  a 
commodity  from  i  toy.  A  model  where  commodity  can  flow  in  either  direction  on  an  arc, 
i.e.,  arcs  are  undirected,  is  discussed  later  in  this  chapter  in  Section  B.5.  A  node  /  can  be 
thought  of  as  a  road  junction  or  waypoint.  A  commodity  flowing  through  the  network 
originates  at  a  source  node  5  e  in  the  network,  and  flows  to  a  sink  node  t  e  N. 

Each  arc  {i,j)  has  an  associated  set  of  parameters  that  describe  its  characteristics. 
The  finite  nominal  capacity,  or  maximum  allowable  flow  on  an  arc  is  denoted  Uy,  where  Uy 
^  0 .  The  cost,  in  units  of  resource,  to  interdict  an  arc  (/,y)  is  ry,  typically  assumed  to  be  a 
small  integer.  It  possible  that  an  arc  cannot  be  interdicted  at  any  cost  for  political,  tactical, 
or  other  reasons  and  therefore  Vy  -  <»  .  K  total  of  i?  units  of  resource  are  available  for 
interdiction.  More  parameters  may  be  considered,  since  it  is  possible  to  include  node 
capacities  and  node  interdictions,  as  discussed  in  Section  B.5  of  this  chapter. 

2.  Network  Maximum  Flow  Models 

The  standard  maximum  flow  linear  programming  model  (e.g.,  Ahuja,  et  al.,  1993, 
p.  168)  determines  the  maximum  quantity  of  a  commodity  that  can  be  moved  through  a 
capacitated  network  from  source  node  5  to  destination  node  t.  This  model  is 
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MF  max  x, 

ts 

X 

s.t.  x  -Y'  x-x=0 

SJ  ^  JS  ts 

J  J 

E^,y-E^j>  =  ®  '^ieN-{s,t) 

J  J 

-  T.  ^  v  ^  x=  0 

^  Jt  ts 

J  J 

0  ^  X  ^  u.  V  (ij)  6  A 

where  is  the  flow  of  commodity  from  node  i  to  node  j  on  directed  arc  (/j)  eA,  and  x^  is 
the  flow  from  sink  node  t  to  source  node  s,  on  an  artificial  arc  (t,s). 

By  partitioning  the  nodes  of  a  network  into  two  sets  and  N^,  with  s  eN^  and 
t  eiVp  the  set  {N^N^  forms  an  s-t  cutset.  With  respect  to  that  cut,  an  arc  is  a  "forward" 
arc  if  it  is  directed  from  a  node  in  to  a  node  in  iV,.  The  capacity  of  the  cut  is  the  sum  of 

the  capacities  of  all  forward  arcs  associated  with  the  cut.  A  minimum  cutset,  then,  is  a 

cutset  of  minimum  capacity  among  all  possible  cutsets  in  the  network.  By  the  well-known 
maximum  flow-minimum  cut  theorem,  the  maximum  flow  in  a  capacitated  network  is 
equal  to  the  minimum  cutset  capacity  (Ford  and  Fulkerson,  1956).  A  minimum  cutset  can 
be  found  directly  by  solving  the  dual  of  the  maximum  flow  problem  (e.g..  Wood,  1993): 

MFD  min  m.B. 

«,P  {ij)e.A 

S.t.  a.  -  a.  +  p..  ^  0 
a  -  a  ^1 

t  S 

p..  s:  0  V(/V)e^. 

Since  MFD  is  totally  unimodular,  all  variables  will  be  0  or  1  in  an  optimal  extreme  point 
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solution.  The  variables  in  the  model  have  the  following  physical  interpretation:  a,  =  1 
indicates  /  e  a,  =  0  indicates  i  e  N^,  and  1  if  arc  (ij)  is  a  forward  arc  of  the 

minimum  capacity  cut  (otherwise  Pj,  =  0). 

3.  The  Network  Interdiction  Problem 

The  network  interdiction  problem  can  be  formalized  in  a  min-max  flow-based 
model.  The  network  user  attempts  to  maximize  the  flow  across  the  network,  while  the 
interdictor  is  simultaneously  striving  to  minimize  this  maximum  flow  while  observing  a 
budget  constraint.  In  this  model,  yy=  1  if  arc  (ij)  is  interdicted  and  jy  =  0  if  the  arc  is  not 
interdicted.  The  model  is 

MINMAX  min  max  x 

Y  e  r  X 

s.t.  'V]  X  -  X  -  x=  0 

J  j 

}  J 

E  -  E 

J  J 

0  ^  X,.  i  tt..(l  -  y.j)  V  iiJ)&A 

where  T  =  {  y ..  ;  y ..  e  {0,1 }  V  (iJ)  e  A ,  Y^j^eA  ^  resource 

constraint  is  for  the  interdiction  of  arcs  using  a  single  type  of  resource;  this  constraint  may 
be  expanded  to  accommodate  multiple  resource  types  and  other  more  complicated 
restrictions.  As  generalizations  of  model  MINMAX,  the  models  presented  in  this  thesis 
allow  multiple  source  and  sink  nodes. 

This  problem  and  some  variants  have  been  extensively  studied  in  the  past  in  a 
planar  network  setting  (e.g.,  Wollmer,  1969),  but  only  recently  has  a  more  general 
mathematical  programming  approach  been  applied  (Steinrauf,  1991;  Wood,  1993).  This 
thesis  will  extend  the  mathematical  programming  approach  and  explore  both  deterministic 
and  stochastic  networks,  and  stochastic  interdictions. 


5 


The  approach  here  is  not  game-theoretic.  In  game  theory,  it  is  assumed  both 
opponents  have  the  ability  to  make  decisions  based  on  known  probabilities  that  the 
opponent  will  take  each  possible  action.  In  contrast,  this  thesis  makes  the  assumption  that 
the  network  interdictor  will  interdict  with  impunity  and  the  network  user  must  maximize 
flow,  subject  to  the  interdictions. 

Once  an  arc  is  interdicted,  the  network  user  is  assumed  to  have  complete 
knowledge  of  the  interdiction  and  reroutes  the  commodity  as  best  possible.  For  example, 
suppose  cocaine  is  being  shipped  into  Miami  from  Columbia  along  two  major  routes:  (1) 
Columbia  -  Nicaragua  -  Miami;  and  (2)  Columbia  -  Jamaica  -  Nassau-  Miami.  Suppose 
each  leg  along  the  major  routes  (1)  and  (2)  can  accommodate  10  kg  and  20kg  of  cocaine 
traffic  per  month,  respectively.  With  no  law  enforcement  action,  30kg  of  cocaine  per 
month  will  arrive  in  Miami.  If  the  budget  allows  one  interdiction,  the  best  choice  is  to 
interdict  any  leg  along  major  route  (2)  (i.e.,  Columbia  -  Jamaica,  Jamaica  -  Nassau,  or 
Nassau  -  Miami)  to  stop  20kg  of  cocaine  per  month.  The  drug  runner  maximizes  drug 
flow  over  the  remaining  network  along  major  route  (1),  still  succeeding  in  delivering  10kg 
per  month  of  cocaine  to  Miami.  If  law  enforcement  had  interdicted  along  major  route  (1) 
instead,  the  drug  runner  could  get  20kg  of  cocaine  per  month  into  Miami  along  the  higher 
capacity  connections  of  major  route  (2).  If  it  costs  law  enforcement  $1M  to  interdict 
major  route  (1),  and  $3M  to  interdict  major  route  (2),  the  interdiction  location  must  be 
major  route  (1)  under  a  $2M  budget  restriction. 

The  above  example  hints  at  the  subtle  role  that  arc  capacity  can  play.  In  the  realm 
of  drug  interdiction,  a  likely  value  of  capacity  may  be  the  greatest  volume  of  drug  traffic 
that  can  be  moved  on  an  arc  during  a  given  time  period  without  attracting  the  attention  of 
law  enforcement.  On  the  other  hand,  a  value  of  capacity  may  be  more  closely  linked  to 
physical  assets.  For  example,  only  a  few  vessels  or  persons  may  be  available  to  complete 
an  ocean  transit  at  any  given  time. 

4.  Basic  Network  Interdiction  Model 

Recent  work  by  Steinrauf  (1991)  and  Wood  (1993)  overcomes  many  shortcomings 
of  previous  models  by  developing  an  integer  programming  model  that  minimizes  the 
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maximum  flow.  This  thesis  expands  upon  their  model,  which  is: 


IPl  mm  V  «  B 

ift'y 

«,P,Y  Oj)e.A 

0  V  (ij)  6  A 
1 

R 

{0,1}  VieN 
{0,1}  ViiJ)eA. 

The  interpretations  of  variables  in  IPl  are  similar  to  those  of  the  dual  of  the 
maximum  flow  formulation  MFD,  with  the  addition  of  the  interdiction  variable,  y.  With 
respect  to  some  cutset  {N„N,},  a,  =  1  indicates  node  i  eN„  a,  =  0  indicates  node  i  eN„ 

=  1  if  arc  (ij)  is  a  forward  arc  of  the  cutset  and  is  interdicted  (otherwise  y,^  =  0),  and  P,^  =  1 
if  arc  (iJ)  is  a  forward  arc  of  the  cutset  but  is  not  interdicted  (otherwise  =  0).  As 
before,  the  resource  constraint  is  for  the  interdiction  of  arcs  using  a  single  type  of 
resource,  but  could  be  expanded  to  handle  multiple  resource  types. 

5.  Undirected  Arcs  and  Interdictable  Nodes 

For  simplicity  of  presentation,  we  develop  network  interdiction  models  considering 
only  directed  arcs  and  interdictions  restricted  to  arcs.  However,  since  undirected  arcs  and 
node  interdictions  are  possible  in  practice,  modified  versions  of  some  models 
accommodating  these  variations  are  also  discussed,  with  computational  results  presented 
in  Chapter  II.  These  variant  models  use  transformations  standard  in  the  literature  (e.g., 
Ahuja,  et  al.,  1993,  pp.  38-43). 

In  many  cases,  including  the  network  interdiction  problem,  it  is  necessary  to 
consider  arcs  that  are  both  directed  and  undirected.  Most  roads,  for  example,  allow 


s.t. 


a .  -  a .  +  P ..  +  Y ..  i 


a  -  a  ^ 

t  S 


^  Y  ^ 
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transport  of  a  commodity  in  either  direction.  To  analyze  such  a  network,  each  undirected 
arc  {i,j)  in  the  original  network  G  =  {N,A)  is  represented  by  two  directed  arcs,  (/j)  and 
(/,/)  in  anti-parallel.  Arcs  {ij)  and  (/’,/)  would  then  exist  in  an  equivalent  transformed 
directed  network,  on  which  all  computations  would  be  performed.  An  interdiction  of  arc 
(/j)  implies  an  interdiction  of  arc  (/,/),  and  vice  versa.  To  effect  this,  the  capacity 
constraint  in  model  MINMAX  is  replaced  by 


0  <  X.  ^  M  ( 1  -  Y  )  1 

tj  ij''  '  IJ-'  I 

0  X  .  ^  «  .  (  1  -  Y  ) 

jt  ij^  '  );>'  J 


V  (iJ)eA. 


The  interdictor,  by  expending  ry  units  of  resource,  stops  the  flow  of  commodity  in  both 
directions  on  undirected  arc 

In  addition  to  interdicting  arcs,  the  network  interdictor  may  find  node  interdiction 
attractive.  This  is  appealling  if  node  capacities  are  smaller  than  or  about  the  same  size  as 
arc  capacities,  or  the  number  of  nodes  in  the  network  is  small  relative  to  the  number  of 
arcs.  Node  interdiction  is  facilitated  by  first  transforming  the  network  by  "node  splitting." 
Such  a  node  i  in  the  original  network  is  split  into  two  nodes  /'  and  i"  in  a  transformed 
network,  joined  by  a  directed  arc  fi*om  /'  to  i"  with  capacity  equal  to  the  capacity  of  the 
original  node  /'.  All  original  arcs  that  were  directed  toward  /  are  now  directed  to  /',  and  all 
arcs  originating  fi-om  i  now  come  exclusively  from  All  such  nodes  in  the  original 
network  are  then  handled  as  arcs  in  the  transformed  network.  An  interdiction  of  "arc" 
(/'/")  is  interpreted  as  an  interdiction  of  node  i  in  the  original  network. 

Admitting  undirected  arcs  and  interdictable  nodes  may  provide  more  realistic 
modeling,  but  computations  can  be  hindered  by  the  larger  size  of  the  transformed  network. 
In  a  large,  undirected  network  with  all  nodes  interdictable,  it  is  possible  the  added 
computational  burden  may  be  substantial. 
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C.  LITERATURE  SEARCH 

During  the  Vietnam  War,  efforts  to  destroy  enemy  supply  lines  produced  the  first 
of  many  studies  of  the  network  interdiction  problem.  The  list  of  contributors  is  extensive: 
Wollmer  (1964,  1970,  1970),  Durbin  (1966),  McMasters  and  Mustin  (1970),  Helmbold 
(1971),  Ghare,  Montgomery,  and  Turner  (1971),  Lubore,  Ratliff,  and  Sicilia  (1971,1975). 
More  recent  contributors  are  Cunningham  (1985),  Steinrauf  (1991),  Phillips  (1992),  and 
Wood  (1993).  The  recent  efforts,  inspired  mostly  by  the  anti-drug  crusade,  have 
attempted  to  generalize  on  the  earlier,  more  specific  approaches.  This  section  describes 
some  of  the  more  interesting  works  on  the  subject. 

1.  Previous  Work 

Many  works  in  the  literature  assume  the  network  in  question  is  "s-t  planar."  A 
network  is  planar  if  it  can  be  drawn  in  a  two-dimensional  plane  such  that  no  two  arcs 
cross  (intersect)  each  other.  A  face  in  a  planar  network  is  a  region  of  the  two-dimensional 
plane  bounded  by  arcs  in  which  any  two  points  can  be  connected  by  a  continuous  curve 
that  intersects  no  nodes  and  no  arcs.  Finally,  an  s-t  planar  network  is  a  planar  network 
with  source  node  s  and  sink  node  t  where  both  s  and  t  lie  on  the  boundary  of  the  outer 
face  (e.g.,  Ahuja,  et  al.,  1993,  pp.  260-263). 

Wollmer  (1964)  first  studied  the  deterministic  network  interdiction  problem. 
Wollmer  starts  by  constructing  a  modified  topological  dual  of  an  undirected  s-t  planar 
network;  dual  network  nodes  are  located  in  each  face  of  the  original  (primal)  network  and 
each  dual  arc  crosses  an  original  arc  to  connect  the  dual  nodes.  The  length  of  each  dual 
arc  is  equal  to  the  capacity  of  the  primal  arc  that  it  crosses.  Reminding  the  reader  of  the 
maximum  flow-minimum  cut  theorem,  Wollmer  shows  how  the  problem  of  finding  the 
minimum  cut  in  the  primal  network  is  equivalent  to  finding  the  shortest  path  through  the 
dual  network  from  the  dual  source  to  the  dual  sink.  If  the  resource  budget  allows  n 
interdictions,  the  n  optimal  arcs  for  interdiction  are  those  arcs  that  when  assigned  zero 
length  will  minimize  the  shortest  route  in  the  dual  network.  He  then  presents  a 
polynomial-time  labeling  algorithm  that  accomplishes  this  by  analyzing  a  modified  dual 
network  in  which  each  dual  arc  is  replaced  by  two  parallel  arcs.  One  arc  has  length  zero 
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and  the  other  has  length  equal  to  the  capacity  of  the  associated  primal  arc.  The  optimal 
set  of  arcs  to  interdict  in  the  primal  network  then  corresponds  to  the  set  of  zero-length 
arcs  in  the  shortest  path  of  the  modified  dual.  Unfortunately,  the  use  of  the  dual  network 
restricts  the  problem  to  planar  graphs,  since  otherwise  the  dual  network  cannot  be 
constructed.  Also,  Wollmer  assumes  that  the  cost  of  interdiction  does  not  vary  from  arc 
to  arc. 

Phillips  (1992)  presents  several  pseudo-polynomial  time  algorithms  using  dynamic 
programming  for  interdiction  of  undirected  planar  networks.  The  algorithms  are  pseudo- 
polynomial  since  they  allow  each  interdiction  to  require  a  different  amount  of  resource. 
Phillips  also  shows  how  to  modify  these  algorithms  to  achieve  approximations  of  the 
optimal  solution  in  polynomial  time.  A  simplifying  assumption  is  made  that  arcs  can  be 
partially  interdicted,  so  that  expending  a  fi'action  of  the  cost  necessary  to  interdict  an  arc 
removes  the  corresponding  fi'action  of  flow.  All  computations  involve  use  of  the  dual  of 
the  network,  similar  to  Wollmer.  However,  there  is  no  requirement  here  that  the  network 
be  s-t  planar.  Phillips  goes  on  to  describe  algorithm  modifications  to  allow  complete  or 
partial  arc  interdiction,  and  to  accommodate  a  general  interdiction  function  such  that  the 
cost  of  interdiction  increases  as  increasing  amounts  of  interdiction  resources  are  expended. 
Finally,  a  proof  shows  that  the  basic  network  interdiction  problem  is  NP-complete. 

Steinrauf  (1991)  and  Wood  (1993)  solve  the  network  interdiction  problem  with 
mathematical  programming  techniques.  By  avoiding  the  use  of  the  dual  network,  the 
topology  of  the  network  is  unrestricted.  Wood  shows  how  the  model  is  easily  generalized 
to  accommodate  binary  (complete)  or  continuous  (partial)  arc  interdiction,  node 
interdiction,  multiple  sources  and  sinks,  undirected  networks,  multiple  resources,  and 
multiple  commodities.  Wood  does  point  out,  however,  that  as  network  interdiction 
problems  become  larger,  certain  measures  may  be  necessary  to  decrease  solution  times. 

To  this  end,  two  types  of  valid  inequalities  are  presented  to  tighten  the  LP  relaxation  of 
the  models.  Although  Wood's  computational  experimentation  does  achieve  a  reduction  in 
solution  time,  a  practical  drawback  of  this  method  is  that  the  amount  of  effort  needed  to 
construct  such  inequalities  may  not  justify  any  time  savings  gained  from  their  use. 
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Although  several  works  on  this  subject  exist,  they  all  may  be  categorized  as  being 
not  as  generalizable  as  Wood's  model,  and  the  models  presented  in  this  thesis. 

D.  PROPOSED  MODELS  AND  SOLUTION  TECHNIQUES 

Motivated  by  a  need  to  solve  network  interdiction  problems  of  increasing  size,  it  is 
useful  to  consider  techniques  other  than  trying  to  solve  the  basic  integer  program  directly, 
with  or  without  valid  inequalities.  Having  recognized  the  advantages  of  the  generality  of 
the  mathematical  programming  approach,  this  thesis  begins  with  the  model  of  Steinrauf 
and  Wood  and  develops  an  alternate  solution  technique  using  Benders  decomposition 
(Benders,  1962).  This  algorithm  decomposes  the  network  interdiction  problem  into  two 
problems  that  are  usually  much  easier  to  solve.  The  simpler  of  the  two  is  a  network 
maximum  flow  problem,  which  is  solved  very  quickly.  The  interdiction  decisions  are  made 
by  an  integer  program  that,  at  the  onset  of  the  algorithm,  also  produces  the  optimal 
solutions  to  a  relaxed  problem  quickly,  since  it  is  small  and  simple.  The  optimal  solution 
to  the  network  interdiction  problem  is  constructed  by  iteratively  solving  these  two 
problems.  The  final  solution  to  the  network  interdiction  problem  should  be  rapidly 
determined  if  the  number  of  iterations  is  not  too  large,  since  the  decomposition  algorithm 
demands  that  the  integer  program  grow  in  size  by  one  constraint  at  each  iteration. 
Therefore,  if  the  number  of  decomposition  algorithm  iterations  is  limited,  some  time 
savings  may  be  achieved  over  directly  solving  the  integer  programming  model. 

With  a  desire  to  solve  practical  problems,  network  interdiction  is  also  addressed  in 
the  stochastic  arena.  Both  simple  and  more  advanced  solution  techniques  are  explored  to 
give  results  under  various  manifestations  of  uncertainty.  Since  the  purpose  here  is  to 
explore  various  methodologies,  and  not  achieve  absolute  efficiency,  all  computations 
should  be  regarded  as  prototypic.  The  General  Algebraic  Modeling  System  (GAMS) 
(Brooke,  et  al.,  1988)  is  used  to  formulate  the  equations  and  interface  the  network  data 
with  the  algorithms.  This  software  is  not  specific  for  this  problem,  or  for  decomposition 
techniques.  Consequently,  more  computation  time  is  required  than  is  actually  necessary  to 
solve  this  problem,  if  software  were  designed  specifically  for  this  purpose.  To  obtain 
solutions  to  the  algorithms  formulated  with  GAMS,  the  solvers  XA  (Sunset  Software, 
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1987)  and  XS  (Insight,  Inc.,  1994)  are  used.  The  final  stochastic  programming  algorithm 
uses  more  advanced  techniques  in  a  sequential-approximation  technique  (Cormican, 
Morton,  and  Wood,  1995).  This  algorithm  is  solved  with  OSL  (International  Business 
Machines  Corp.,  1991). 

The  algorithms  and  solution  techniques  explored  in  this  thesis  are: 

1.  Deterministic  Networks  with  Benders  Decomposition 

This  method  employs  an  iterative  solution  procedure  using  Benders 
decomposition.  In  the  Benders  master  problem,  a  set  of  arcs  is  chosen  for  interdiction 
subject  to  a  budget  constraint.  The  Benders  subproblem  maximizes  flow  subject  to  fixed 
interdiction  locations.  The  master  and  subproblems  are  solved  iteratively  until  the  gap 
between  the  lower  bound  from  the  master  problem  and  the  upper  bound  from  the 
subproblem  is  small  enough  to  satisfy  optimality  criteria  set  by  the  user. 

2.  Deterministic  Networks  with  Benders  Decomposition  and  Heuristic 

A  modification  to  the  straightforward  Benders  decomposition  algorithm,  this 

technique  employs  a  "flow-dispersion"  heuristic  after  solving  the  Benders  subproblem. 

The  heuristic  has  the  effect  of  dispersing  the  maximum  flow  from  source(s)  to  sink(s) 
throughout  the  network  by  approximately  solving  a  minimum  cost  flow  problem  with  a 
quadratic  cost  function  that  keeps  flow  on  any  arc  no  larger  than  it  has  to  be  to  still 
achieve  the  maximum  flow  through  the  network.  The  result  is  more  rapid  convergence  of 
the  upper  and  lower  bounds,  decreasing  the  time  and  number  of  algorithm  iterations 
required  to  produce  a  satisfactory  solution. 

3.  Simple  Stochastic  Models  with  Benders  Decomposition 

If  there  is  some  uncertainty  with  respect  to  arc  capacities,  a  set  of  "scenarios"  may 
be  constructed  where  each  scenario  is  one  realization  of  several  possible  combinations  of 
arc  capacities  in  the  network.  Assigned  to  each  scenario  is  a  probability  that  the  scenario 
represents  the  actual  network,  with  all  arc  capacities  as  specified  in  the  scenario.  In  this 
treatment,  uncertain  capacity  also  models  uncertain  network  topology  since  an  arc  with  a 
capacity  of  zero  models  an  "arc"  that  is  not  present  in  the  actual  network.  If  the  number 
of  possible  scenarios  is  manageable,  direct  integer  programming  may  be  used,  but  as  the 
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number  of  scenarios  grows,  Benders  decomposition  becomes  more  attractive.  The 
application  of  Benders  decomposition  to  a  set  of  probabilistic  scenarios  was  developed  as 
the  L-shaped  algorithm  by  Van  Slyke  and  Wets  (1969). 

4.  Stochastic  Networks  with  a  Sequential-Approximation  Algorithm 

If  the  number  of  probabilistic  scenarios  becomes  too  large,  the  scenario  method 
becomes  computationally  burdensome  since  the  number  of  Benders  subproblems  to  solve 
at  each  iteration  is  equal  to  the  number  of  scenarios.  To  avoid  such  difficulties,  a 
sequential-approximation  algorithm  is  employed  (Cormican,  Morton,  and  Wood,  1995; 
Kail,  et  al.,  1988).  This  algorithm  sequentially  refines  partitions  of  the  sample  space  and 
employs  the  L-shaped  algorithm  to  solve  a  sequence  of  approximating  problems.  This 
technique  can  accommodate  uncertainty  in  arc  capacities  as  well  as  interdiction  success, 
and  assumes  all  random  variables  are  independent.  In  this  thesis,  we  explore  only  the 
situation  where  uncertainty  takes  the  form  of  complete  success  or  failure  for  interdiction 
attempts.  It  is  possible  to  extend  the  methodology  to  discrete  and  continuous  distributions 
for  interdiction  success  and  arc  capacities,  as  well  as  certain  types  of  dependency 
structures  for  the  stochastic  parameters,  but  these  topics  are  beyond  the  scope  of  this 
research. 
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n.  DETERMINISTIC  NETWORK  INTERDICTION 


Solving  network  interdiction  problems  on  large  networks  may  be  computationally 
impossible  with  standard  integer  programming  techniques.  This  possibility  motivates  the 
evaluation  of  decomposition  techniques  that  separate  a  large  complicated  problem  into  a 
sequence  of  smaller,  quicker-to-solve  models.  In  this  chapter.  Benders  decomposition  for 
the  deterministic  network  interdiction  problem  is  developed,  improved  upon,  and 
computationally  tested. 

A.  NETWORK  INTERDICTION  WITH  BENDERS  DECOMPOSITION 

In  this  section,  a  decomposed  formulation  is  developed  from  the  integer  program 
formulation  and  is  computationally  tested. 

1.  Model 

Benders  decomposition  is  a  solution  technique  that  is  best  applied  when  a  certain 
set  of  "complicating"  variables  link  what  would  otherwise  be  separate,  easily  solved 
models.  The  network  interdiction  problem  is  a  prime  candidate  for  Benders 
decomposition  due  to  the  complicating  binary  interdiction  variables:  if  the  interdiction 
variables  are  fixed  at  zero  or  one  for  every  arc,  the  resulting  model  is  a  network  flow 
problem  that  is  easily  solved  by  several  methods.  If  the  choices  for  interdiction  can  be 
made  relatively  quickly  at  each  iteration,  the  decomposed  problem  may  offer  some 
advantage  over  the  original  integer  program  model.  The  derivation  of  the  decomposed 
model  begins  with  Wood's  basic  model,  which  is  restated  as 
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Y,P,a  {ij)e.A 


F  6 ..  +  Y 

0 

a  -  a 

1 

t 

S 

E 

r  Y 

y  ‘  ij 

R 

a.  e  {0,1}  \/  ieN 


p.,Yy  e  {0,1}  V  (v)e^. 


For  fixed  values  of  y,  the  LP  relaxation  of  IPl  is  just  the  dual  of  a  network  flow 
problem  with  an  intrinsically  integer  solution.  The  dual  of  this  LP  relaxation  may  be  taken 
to  obtain  the  equivalent  problem: 


mm  max 


-  E 


Y^r  ^ 

s.t.  T'  X  .  -  X.  -  X  =  0 

Z— ^  s}  Z— <  js  ts 

J  J 

E  -  E  0  V  /  6  -  {5,f} 

/  / 

E  -  E  ^  =  0 


(/*  Z-^  jt 

J  J 


0  ^  X..  ^  u..  V  (iJ)eA 


wherer={Y..  :y..6{0,1}  V  (ij)  e  A 

Now,  enumerate  the  set  X  of  all  the  extreme  point  solutions  of  the  inner 
maximization  and  select  that  solution  with  minimum  value  subject  to  y  e  F.  This  model 
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may  be  written  as 


k  k 

nun  max  x,  -  >  y  x... 

ts  ^  I  g  y 

yer  x*e.X  iiJ)eA 


Equivalently,  the  min-max  problem  may  be  written  as  the  simple  minimization: 


MASTER  iX)  min  z 

Y  er 

s.t.  Z  ^  -  Y  Yy.  Vx'eX 

(W)e^ 

Yye{0,l}  \/(iJ)eA. 

The  efficiency  of  Benders  decomposition  rests  on  the  ability  to  solve  MASTER(A) 
with  the  enumeration  of  only  a  fraction  of  the  extreme  points  X.  The  formulation  with  a 
subset  of  constraints  corresponding  to  extreme  points  Z'  c  X  is  the  Benders  master 
problem,  denoted  MASTER(A^.  Each  constraint  in  the  master  problem  is  generated  by 
the  Benders  subproblem.  At  each  iteration  in  the  algorithm,  the  solution  to  the 
subproblem  is  checked  to  see  if  h  violates  any  constraints  in  MASTER(X').  If  so,  X  and 
MASTER(Jf')  are  updated  with  the  solution  to  the  subproblem  (an  extreme  point).  This 
iterative  process  repeats  until  the  solution  to  the  subproblem  is  feasible  to  MASTER(A^. 
At  this  point,  MASTER(Jf')  has  enough  information  to  solve  the  original  problem  to 
optimality.  Furthermore,  each  iteration  of  the  master  problem  produces  a  non-decreasing 
lower  bound  (LB)  on  the  optimal  value  of  the  objective  function.  Similarly,  the 
subproblem  will  generate  an  upper  bound  (UB,  not  necessarily  non-increasing)  at  each 
iteration.  With  this  information,  the  algorithm  may  be  terminated  prior  to  optimality  if  the 
gap  between  the  current  lower  bound  and  best  upper  bound  is  sufficiently  small. 

The  Benders  subproblem  is 
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SUB  (^) 


max  X,  -  'y  X  Y  . 

ts  ij  *  ij 

s.t.  y  X .  -  y  X.  -  x=  0 

sj  2-^  js  ts 

}  J 

E  -  E  ^  V  /•  €  i\r  -  {5,0 

/  / 

y  x-Y  jc  ,  ^  r  =  0 

^  jt  ts 

J  J 


0  5  X..  ^  u..  V  (ij)eA 


where  y  is  the  solution  to  MASTER(X').  The  subproblem  is  simply  a  variant  of  the 
maximum  flow  formulation  that  penalizes  flow  on  any  arc  chosen  for  interdiction  in  the 
master  problem.  Letting  z{f)  denote  the  optimal  value  of  the  objective  function  to  the 
optimization  problem/  the  algorithm  is; 


Benders  Decomposition  Algorithm  for  Network  Interdiction 

Input:  Network  G={N,A),  arc  capacities  u^,  arc  interdiction 
costs  r^j,  interdiction  budget  R,  special  nodes  s  and  t, 
convergence  tolerance  toler. 

Output:Interdiction  vector  Y*,  which  is  the  solution  within  (100  •  tolerfA 
of  optimality. 

step  1  Solve  maximum  flow  problem  MF  for  flow  values 
Let^'=  {x*}; 

Let  k  =  2; 

LetUB=z(MF) 

step  2  Solve  MASTER(X')  for  ^ ; 

Let  LB  =  2  (MASTER(^) 

step  3  Solve  SUB(  y  )  for  x’^; 

LetA'  =  X'U{x^}; 

Ifz(SUB)  <  UB  then  let  UB  =  2(SUB(^  ))  and  Y‘=  y  i 

step  4  If  UB  -  LB  ^  LB  •  toler  then  stop:  Interdiction  set 

Y  ’  is  a  solution  to  the  network  interdiction  problem  with 
objective  function  value  within  (100  •  toler)Vo  of  the  optimal 
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objective  function  value. 


Steps  Letk  =  k+  1; 

Go  to  step  2. 

2.  Computational  Results 

In  the  network  interdiction  problem,  there  are  potentially  unlimited  numbers  of 
combinations  of  network  size  and  topology,  arc  direction,  arc  and  node  capacities,  arc  and 
node  interdiction  costs,  resource  budget,  and  prohibited  interdiction  locations.  We 
present  only  a  few  test  cases  using  GAMS  to  construct  simple  grid  networks  as 
hypothetical  capacitated  transportation  networks  for  our  calculations. 

Since  some  coherence  in  tests  is  desirable  between  different  solution  techniques  to 
allow  meaningful  comparisons,  some  of  the  characteristics  listed  above  remain  unaltered  in 
all  cases  studied.  Any  exception  cases  to  the  following  "fixed"  characteristics  are  clearly 
labeled.  Three  network  sizes  are  analyzed,  as  shown  in  Figure  1.  All  data  used  in  the  test 
cases  is  available  from  the  advisors  of  this  thesis. 


Small  network  (NS);  100  nodes,  180  directed  arcs,  10  by  10  grid; 

Medium  network  (NM);  900  nodes,  1740  directed  arcs,  30  by  30  grid; 

Large  network  (NL):  3200  nodes,  6280  directed  arcs,  40  by  80  grid. 

Figure  1 .  Networks  for  Case  Studies 

In  networks  NS  and  NM,  all  exterior  nodes  on  one  side  of  the  grid  are  defined  as  source 
nodes,  while  all  nodes  at  the  opposite  side  of  the  grid  are  defined  as  sink  nodes.  In 
network  NL,  the  nodes  at  the  40-node  sides  of  the  grid  are  similarly  defined  as  source  and 
sink  nodes.  Note  that  the  techniques  presented  in  this  thesis  do  not  require  source  and 
sink  nodes  be  exterior  nodes  of  a  network. 
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Other  network  and  network  interdiction  characteristics  that  remain  unchanged 
throughout  all  testing  are  shown  in  Figure  2. 


Arc  capacity  range:  [10, 100],  uniformly  distributed  in  increments  of  ten; 

Node  capacity  range:  [10,200],  uniformly  distributed  in  increments  of  ten; 

Resource  cost  of  interdiction,  each  arc:  1  (except  where  noted); 

Probability  that  any  arc  (node)  is  available  for  interdiction:  50%. 

Figure  2.  Fixed  Data  Characteristics  for  Network  Interdiction  Case  Studies 

It  is  desirable  to  perform  all  calculations  with  the  same  hardware,  but  the 
computational  demands  of  the  larger  problems  make  this  impractical.  Consequently,  the 
less  demanding  cases  are  solved  using  a  60  MHZ  Pentium  PC  and  the  more  difficult  cases 
utilize  an  IBM  RISC/6000  Model  590.  Since  our  interest  is  not  particular  to  any  one  data 
set,  we  present  summarized  case  results:  the  number  of  Benders  decomposition  algorithm 
iterations  performed  for  convergence,  total  "clock"  time  for  computations,  and  total  solver 
time  for  computations,  where  the  (significant)  difference  between  clock  and  solver  is  time 
required  for  the  operations  of  the  GAMS  interface. 

A  total  of  seven  cases  are  tested  with  the  Benders  decomposition  algorithm.  The 
first  four  cases  are  performed  on  network  NS,  with  varying  resource  levels  R.  In  one  of 
the  instances  where  R  =  3,  approximately  one-half  of  the  arcs  have  interdiction  costs  - 
2;  all  other  cases  consider  only  =  1 .  The  next  two  cases  use  network  NM  with  two 
values  of  R.  Initial  results  show  that  solving  network  NM  with  i?  >  6,  or  solving  network 
NL  with  only  the  Benders  decomposition  algorithm,  is  not  efiBcient.  These  cases  are 
solved,  however,  by  other  means  in  subsequent  sections  of  this  thesis. 

Assuming  characteristics  outlined  in  Figure  2,  a  summary  of  results  for  network 
NS  follows  in  Table  1 .  The  60  Mhz  Pentium  PC  is  used  for  these  calculations.  The 
medium  network  NM  was  also  examined  also  using  the  60  Mhz  Pentium  PC.  With  the 
Figure  2  assumptions  of  characteristics,  a  summary  for  network  NM  is  in  Table  2. 

From  the  data  in  Tables  1  and  2,  it  is  evident  that  an  increase  in  computational 
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difficulty  is  experienced  as  the  resource  budget  R  increases.  The  test  with  R  =  9  was 
terminated  when  the  time  required  to  achieve  a  satisfactory  solution  was  deemed 


SMALL 

NETWORK 

CASE(NS) 

NUMBER  OF 
BENDERS 
ITERATIONS 

TOTAL 

SOLVER 

TIME  (hr:min:sec) 

lESR 

R=\ 

1 

00:00:00.8 

00:00:15 

R  =  3 

5 

00:00:02.5 

00:00:44 

R  =  3,  r,^=l  or  2 

5 

00:00:02.6 

00:00:44 

R  =  6 

8 

00:00:04.6 

00:01:10 

Table  1.  Benders  Decomposition  Algorithm  Summary  of  Results,  Small  Network. 

Solving  the  network  interdiction  problem  on  network  NS  using  the  Benders  decomposition 
algorithm,  with  6  units  of  interdiction  resource,  takes  8  iterations  of  the  algorithm,  4.6 
seconds  of  solver  time,  and  1  minute  and  10  seconds  of  clock  time. 

excessive.  All  of  this  additional  time  is  spent  solving  the  Benders  master  problem, 
MASTER(X').  This  is  intuitive,  as  the  budget  constraint  is  of  a  0-1  knapsack  variety  and 
the  number  of  possible  combinations  of  feasible  interdictions  grows  exponentially  with  R. 


MEDIUM 

NETWORK 

CASE(NM) 

NUMBER  OF 
BENDERS 
ITERATIONS 

IIEI9I 

TOTAL 

CLOCK 

TIME(hr :  min :  sec) 

II 

8 

00:00:24.2 

00:02:59 

R  =  6 

16 

00:00:38.6 

00:10:35 

R  =  9 

>40 

>06:12:00 

>  09:00:00 

Table  2.  Benders  Decomposition  Algorithm  Summary  of  Results,  Medium  Network. 

Solving  the  network  interdiction  problem  on  network  NM  using  the  Benders  decomposition 
algorithm,  with  9  units  of  interdiction  resource,  takes  more  than  40  iterations  of  the 
algorithm,  more  than  6  hours  and  12  minutes  of  solver  time,  and  more  than  9  hours  of  clock 
time. 

To  demonstrate  the  simple  extension  of  network  interdiction  problems  on 
undirected  networks  where  node  interdiction  is  also  allowed,  two  cases  were  studied  using 
network  NS',  which  is  network  NS  modified  to  have  either  one-half  or  all  of  its  arcs 
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undirected.  The  results  are  in  Table  3.  Interestingly,  the  number  of  undirected  arcs  had 
very  little  effect  on  the  time  required  in  this  small  problem. 


SMALL 

NUMBER  OF 

TOTAL 

TOTAL 

NETWORK 

BENDERS 

SOLVER 

CLOCK 

CASE(NS') 

ITERATIONS 

TIME  (hr:min:sec) 

■iiSminBiSB 

7?  =  3,  50% 
undirected  arcs 

10 

00:00:07.6 

00:02:08 

7?  =  3,  100% 
undirected  arcs 

10 

00:00:07.7 

00:02:08 

Table  3.  Benders  Decomposition  Algorithm  Summary  of  Results,  Small  Network  with 
Directed  and  Undirected  Arcs,  Node  Interdictions  Allowed.  Solving  the  network 
interdiction  problem  on  network  NS'  using  the  Benders  decomposition  algorithm,  with  all  arcs 
undirected  and  3  units  of  interdiction  resource,  takes  10  iterations  of  the  algorithm,  7.7 
seconds  of  solver  time,  and  2  minutes  and  8  seconds  of  clock  time. 

B.  ALGORITHM  IMPROVEMENTS 

The  objective  functions  of  the  Benders  master  and  subproblem  must  converge  in  a 
finite  number  of  iterations  (Benders,  1962).  Unfortunately,  the  number  of  iterations 
required  for  convergence  may  be  large.  It  is  useful  to  consider  techniques  that  decrease 
solution  time  by  reducing  the  number  of  iterations  the  Benders  decomposition  algorithm 
requires  for  convergence. 

1.  Flow  Dispersion  Heuristic 

Comparisons  of  solutions  to  the  maximum  flow  problem  and  the  interdiction 
problem  suggest  that  arcs  that  are  capacitated,  or  nearly  capacitated,  are  interdicted  more 
often  than  those  with  little  or  no  flow  in  the  optimal  solution  to  the  maximum  flow 
problem.  This  result  supports  intuition,  and  leads  to  the  following  argument: 


In  solving  the  master  problem,  the  interdictor  may  achieve  a  "better" 
interdiction  by  interdicting  arcs  where  is  large.  It  is  therefore  likely  that 
yy  will  be  1  where  is  large.  But,  the  magnitude  of  ^y  may  be  misleading. 
It  may  be  large,  but  if  arc  (ij)  is  interdicted,  the  flow  might  be  able  to  be 
rerouted  with  little  or  no  loss.  The  network  user,  consequently,  would  like 
:^y  to  be  closer  to  the  "true"  value  necessary  to  achieve  a  maximum  flow. 
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To  this  end,  we  will  require  the  network  user  to  maximize  flow  while 
simultaneously  keeping  flow  on  any  individual  arc  as  small  as  possible,  in 
some  crude  sense.  In  such  a  solution,  if  is  large,  it  is  large  only  because 
it  must  be  to  achieve  a  maximum  flow. 

If  the  maximum  flow  problem  MF  is  first  solved  for  the  value  MAXFLOW  =  z(MF),  the 
solution  to  the  following  nonlinear  program  will  achieve  a  maximum  flow  and  tend  to  keep 
flows  on  individual  arcs  as  small  as  possible: 

NLP  min  V  jc.f 

^  i; 


E 

} 

X  .  - 

E 

J 

X 

=  MAXFLOW 

E 

} 

X..  - 
V 

E 

J 

X 

Ji 

=  0  VieN- 

E 

E 

=  -MAXFLOW 

J  J 


0  5  ^  V(iJ)eA. 

Solving  this  nonlinear  program  exactly  is  computationally  difficult.  One  exact  solution 
method,  simplicial  decomposition,  has  been  considered  promising  but  is  not  tested  since  a 
solver  employing  this  method  is  not  available.  Since  the  proposed  technique  is  a  heuristic, 
approximate  solutions  to  NLP  may  be  sufficient  to  produce  a  satisfactory  flow  dispersion. 
This  reduces  the  time  needed  to  solve  NLP.  Three  approximate  solution  methods  are 
explored  in  this  thesis: 

a.  Many-Level  Approximation  Method 

The  separable  quadratic  objective  function  can  be  approximated  by  a  sum 
of  piecewise  linear  functions  composed  of  n  linear  segments  of  equal  length.  This 
corresponds  to  the  replacement  of  each  original  arc  with  n  parallel  arcs,  each  with  capacity 
ujn.  Each  new  arc  is  labeled  as  a  "level,"  /,  from  1  to  «,  and  usage  costs  increase  as  the 
square  of  the  level  of  the  arc  used.  This  method  very  closely  approximates  a  quadratic 
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function,  but  has  the  disadvantage  of  increasing  the  number  of  arcs  in  the  network  w-fold. 

b.  Two-Level  Iterative  Approximation  Method 

The  quadratic  functions  can  be  approximated,  with  iterative  improvements, 
using  a  two-segment  linear  approximation.  Given  an  initial  approximation,  the  resulting 
flow  values  are  then  used  to  adjust  the  lengths  (capacities)  and  slopes  of  the  two  linear 
segments  to  reduce  the  error  between  the  linear  approximation  and  a  true  quadratic 
function.  This  process  is  repeated  several  times  for  the  best  approximation.  This  heuristic 
requires  each  original  arc  to  be  replaced  by  only  two  parallel  arcs,  each  with  capacity  uJ2, 
only  doubling  the  number  of  arcs  in  the  network. 

c.  Frank-Wolfe Method 

Developed  as  a  method  to  solve  quadratic  programming  problems,  the 
Frank-Wolfe  algorithm  is  widely  used  in  non-linear  programming  (e.g.,  Bazaraa  and 
Shetty,  1979,  p.  184).  It  is  ideal  for  implementation  of  the  flow-dispersion  heuristic. 

Starting  with  a  feasible  solution  x  to  NLP,  the  direction  of  movement  for 
an  improved  objection  function  value  is  -^f^x) ,  projected  onto  the  feasible  region.  For 
NLP,  one  direction-finding  problem  is  given  by  the  following  LP; 


DFP(^) 


min  V  2  x  .x . 

ij  ij 

X 

S  t-  E  -  E 

J  J 

X  =  MAXFLOW 

p 

E  %  -  E 

J  J 

=  0  V  i  e  N  -  {5,/} 

E  ^  -  E 

X.,  =  -MAXFLOW 

jt 

0  <  X..  ^  M..(l  -  V  iiJ)eA 


where  MAXFLOW  =  z(MF),  as  before.  If  x  is  not  optimal,  an  improving  direction  is 
d  =  X  -  X,  where  x solves  DFP(  x).  The  optimal  step  size.  A,*,  is  easily  found  by 
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solving 


“in  /  (A  X  +  (1  -  A.)  x.  ) 

A.  •' 

S.t.  0  A  ^  1 

where  f(x)  =  x^. .  Differentiating  with  respect  to  X  and  setting  the  result  equal  to 

zero,  the  optimaHtqj  size  is 


A*  = 


E 

Oj)^a 


a2 


-  E 


A  — 

X  X.. 
V  V 


E 

(ij)eA 


A2 


E 

(iJ)eA 


-2 


2E 

(ij)eA 


A  — 

X,,  X.. 

y  y 


Because  it  may  be  impractical  to  find  x  *  exactly,  we  use  a  stopping  rule  to 
obtain  a  solution  sufficiently  close  to  x  * .  The  number  of  times  x  and  A  ‘must  be 
determined  will  depend  on  this  stopping  rule.  Certainly,  /(x)  s:  /(x  *)  since  x  is  a 
feasible  solution  to  DFP(x).  We  know /(x‘)  ^  /(x)  +  V/(x)(x*  -  x),  and  since 
X  minimizes  DFP(x),  it  follows  that  f(x  *)  ^  /(x)  +  Vf(x)  -  x) .  Asa  result  we 
can  employ  a  relative  stopping  rule  by  checking  the  magnitude  of  the  relative  gap  between 
X  and  X .  The  algorithm  for  this  method  is  now  apparent  as; 

Frank-Wolfe  Algorithm  for  Heuristic 

Inputs:  Network  G=(N,A),  current  arc  flows  x,  relative  gap  e . 

Output;  Adjusted  arc  flows  x . 

step  1  Solve  DFP(  x )  for  x ; 
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If 


2  T  X,,  -  2T  X  X.. 

^  V  ^  1}  tj 


2  £  S,.  i..  -  r 

IJ  IJ  IJ 

(ij)eA  (ij')e.A 


<  e ,  then  stop 


step  2  Compute  A,  ’ 

step  3  Update  3c  :3c  A,*3c  +  (1  -  A,’)jc; 

Go  to  step  1 . 


This  algorithm  is  a  variant  of  the  Steepest  Descent  Method,  and  as  a  first-order  nonlinear 
method  tends  to  stall,  or  converge  poorly,  as  the  optimal  solution  is  approached  (e.g., 
Bazaraa  and  Shetty,  1979,  p.  290).  This  may  not  be  a  significant  problem,  however,  since 
it  is  not  necessary  to  solve  the  problem  exactly. 

2.  Computational  Results 

Several  cases  are  tested  with  the  Benders  decomposition  algorithm  and  the 
different  implementations  of  the  flow-dispersion  heuristic.  The  final  cases  analyze 
network  ML  with  the  most  efficient  heuristic  technique  and  compare  the  results  with  those 
obtained  from  direct  integer  programming.  To  allow  comparison,  all  data  for  the  cases 
tested  here  are  the  same  as  those  in  Section  A,  where  the  heuristic  is  not  used. 

Table  4  presents  a  summary  of  results  for  network  NS  with  the  many-level 
approximation  method.  Also  given  is  the  percent  of  time  or  iterations  the  algorithm 
required  compared  to  the  straightforward  Benders  decomposition  algorithm  without  the 
heuristic  as  tested  in  Section  A  of  this  chapter. 
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SMALL 

NETWORK 

CASE(NS) 


BENDERS 

ITERATIONS 


SOLVER 
TIME  (hr:min:sec) 


NUMBER 

OF 


% 

OF 

SEC.  A 


TOTAL 


% 

OF 

SEC.  A 


TOTAL 

CLOCK 

TIME(hr  :min:  sec) 


100% 

00:00:02.3 

288% 

00:00:22 

40% 

00:00:04.1 

164% 

00:00:35 

80% 

00:00:07.8 

300% 

00:01:05 

200% 

00:00:38.6 

839% 

00:04:22 

R  =  1 


R  =  3 


7?  =  3,r  =l  or2 


Table  4.  Benders  Decomposition  Algorithm  with  Heuristic:  Many-Level 
Approximation  Method  Summary  of  Results,  Small  Network.  Solving  the  network 
interdiction  problem  on  network  NS  using  the  Benders  decomposition  algorithm  with  the 
many-level  approximation  implementation  of  the  flow-dispersion  heuristic,  with  3  units  of 
interdiction  resource,  took  2  iterations  of  the  algorithm,  4.1  seconds  of  solver  time,  and  35 
seconds  of  clock  time.  This  is  40%  of  the  number  of  iterations  and  164%  of  the  solver  time 
required  to  solve  the  problem  with  Benders  decomposition  alone. 

Using  the  two-level  iterative  approximation  method,  the  results  are  in  Table  5. 


SMALL 

NETWORK 

CASE(NS) 


R=\ 


R  =  3 


R  =  3,  r,f=\  or  2 


R  =  6 


BENDERS 

ITERATIONS 


NUMBER 

OF 


% 

OF 

SEC.  A 


% 

OF 

SEC.  A 


TOTAL 

CLOCK 

TIME(hr:min:sec) 


100%  00:00:01.2  150% 


60%  00:00:04.7  188% 


60%  00:00:05.6  215% 


163%  00:00:30.4  661% 


00:00:19 


00:00:56 


00:01:02 


00:04:20 


Table  5.  Benders  Decomposition  Algorithm  with  Heuristic:  Two-Level  Iterative 
Approximation  Method  Summary  of  Results,  Small  Network.  Solving  the  network 
interdiction  problem  on  network  NS  using  the  Benders  decomposition  algorithm  with  the 
two-level  iterative  approximation  implementation  of  the  flow-dispersion  heuristic,  with  3  units 
of  interdiction  resource,  took  3  iterations  of  the  algorithm,  4.7  seconds  of  solver  time,  and 
56  seconds  of  clock  time.  This  is  60%  of  the  number  of  iterations  and  188%  of  the  solver 
time  required  to  solve  the  problem  with  Benders  decomposition  alone. 
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The  Frank-Wolfe  method  produced  the  results  in  Table  6.  In  this  instance,  the 
Frank-Wolfe  implementation  of  the  heuristic  seems  to  be  most  effective  in  the  case  where 
diflFering  arc  interdiction  costs  are  present. 


SMALL 

BENDERS 

ITERATIONS 

SOLVER 
TIME  (hr:min:sec) 

TOTAL 

NETWORK 

CASE(NS) 

NUMBER 

OF 

% 

OF 

SEC.  A 

TOTAL 

% 

OF 

SEC,  A 

CLOCK 

TIME(hr :  min;  sec) 

R=\ 

1 

100% 

00:00:01.0 

125% 

00:00:19 

R  =  3 

3 

60% 

00:00:06.2 

248% 

00:01:18 

R  =  3,r,j=l  or  2 

2 

40% 

00:00:03.6 

138% 

00:00:46 

R  =  6 

14 

175% 

00:00:46.2 

1004% 

00:07:43 

Table  6,  Benders  Decomposition  Algorithm  with  Heuristic:  Frank-Wolfe  Method 
Summary  of  Results,  Small  Network.  Solving  the  network  interdiction  problem  on 
network  NS  using  the  Benders  decomposition  algorithm  with  the  Frank-Wolfe 
implementation  of  the  flow-dispersion  heuristic,  with  3  units  of  interdiction  resource,  took  3 
iterations  of  the  algorithm,  6.2  seconds  of  solver  time,  and  1  minute  and  18  seconds  of  clock 
time.  This  is  60%  of  the  number  of  iterations  and  248%  of  the  solver  time  required  to  solve 
the  problem  with  Benders  decomposition  alone. 

The  medium  network  NM  is  also  examined  using  a  60  Mhz  Pentium  PC.  Table  7 
shows  a  summary  for  network  NM  using  the  many-level  approximation  method  with  the 
standard  assumptions  of  characteristics.  Due  to  the  poor  performance  of  the  case  where 
/?  =  9  in  Table  2,  no  test  is  performed  in  Section  A  for  a  case  where  R=\2  using  only  the 
Benders  decomposition  algorithm.  The  case  where  /?  =  9  is  a  striking  demonstration  of 
the  usefulness  of  the  flow-dispersion  heuristic.  With  the  exception  of  the  case  where  R  = 

6  using  network  NS,  the  heuristic  has  been  successful  in  reducing  the  number  of  iterations 
of  the  algorithm,  but  is  unsuccessful  at  improving  solver  time.  The  7?  =  9  case  in  Table  7, 
however,  clearly  shows  that  it  is  possible  to  significantly  decrease  the  solver  time  by  using 
the  heuristic. 


MEDIUM 

NETWORK 

CASE(NM) 

BENDERS 

ITERATIONS 

lll!lll!lll 

TOTAL 

CLOCK 

TIME(hr;min:  sec) 

NUMBER 

OF 

% 

OF 

SEC.  A 

TOTAL 

% 

OF 

SEC.  A 

11 

2 

25% 

00:00:42.3 

175% 

00:03:10 

R  =  6 

3 

19% 

00:01:00.3 

156% 

00:04:31 

R  =  9 

7 

<  18% 

00:02:26.9 

<  1% 

00:10:24 

R^12 

15 

NA 

00:27:31.6 

NA 

00:44:31 

Table  7.  Benders  Decomposition  Algorithm  with  Heuristic:  Many-Level 
Approximation  Method  Summary  of  Results,  Medium  Network.  Solving  the  network 
interdiction  problem  on  network  NM  using  the  Benders  decomposition  algorithm  with  the 
many-level  approximation  implementation  of  the  flow-dispersion  heuristic,  with  9  units  of 
interdiction  resource,  takes  7  iterations  of  the  algorithm,  2  minutes  and  26.9  seconds  of  solver 
time,  and  10  minutes  and  24  seconds  of  clock  time.  This  is  less  than  18%  of  the  number  of 
iterations  and  less  than  1%  of  the  solver  time  required  to  solve  the  problem  with  Benders 
decomposition  alone.  No  comparison  is  made  for  the  test  case  where  R  =  12. 


The  two-level  iterative  approximation  method  results  are  in  Table  8  and  the  results 
using  the  Frank-Wolfe  method  are  in  Table  9.  Now,  the  results  in  Table  4  through  Table  9 
show  that  the  heuristic  is  almost  always  useful  for  decreasing  the  required  number  of 
Benders  iterations.  Unfortunately,  this  is  not  always  accompanied  by  a  decrease  in  solver 
times.  This  is  due  to  running  the  heuristic  at  each  iteration.  With  only  a  few  test  cases 
here,  it  is  not  possible  to  state  conclusively  that  the  heuristic  has  either  a  positive  or 
negative  effect  on  required  solver  time,  but  there  is  some  indication  that  it  may  be  more 
effective  on  the  larger  and  more  difficult  problems. 


MEDIUM 

NETWORK 

CASE(NM) 


R  =  3 


R^6 


R  =  9 


R=U 


BENDERS 

ITERATIONS 


NUMBER 

OF 


% 

OF 

SEC.  A 


TOTAL 


% 

OF 

SEC.  A 


TOTAL 

CLOCK 

TIME(hr:min;sec) 


25%  00;00;23.3  96% 


19%  00:00:39.2  102% 


<50%  00:43:59.6  <12% 


01:48:38.0 


00:02:35 


00:04:12 


03:41:10 


04:03:40 


Table  8.  Benders  Decomposition  Algorithm  with  Heuristic:  Two-Level  Iterative 
Approximation  Method  Summary  of  Results,  Medium  Network.  Solving  the  network 
interdiction  problem  on  network  NM  using  the  Benders  decomposition  algorithm  with  the 
two-level  iterative  approximation  implementation  of  the  flow-dispersion  heuristic,  with  9  units 
of  interdiction  resource,  takes  20  iterations  of  the  algorithm,  43  minutes  and  59.6  seconds  of 
solver  time,  and  3  hours,  41  minutes,  and  10  seconds  of  clock  time.  This  is  less  than  50%  of 
the  number  of  iterations  and  less  than  12%  of  the  solver  time  required  to  solve  the  problem 
with  Benders  decomposition  alone.  No  comparison  is  made  for  the  test  case  where  R  -  12. 


MEDIUM 

BENDERS 

ITERATIONS 

SOLVER 
TIME  (hr:min:sec) 

TOTAL 

NETWORK 

CASE(NM) 

NUMBER 

OF 

% 

OF 

SEC  A 

TOTAL 

% 

OF 

SEC.  A 

CLOCK 

TIME(hr:  min:  sec) 

II 

3 

38% 

00:00:49.1 

203% 

00:10:53 

R  =  6 

5 

31% 

00:02:19.1 

360% 

00:23:07 

R  =  9 

12 

<  30% 

00:08:53.6 

<3% 

01:23:04 

R=12 

28 

NA 

01:35:43.5 

NA 

04:39:16 

Table  9.  Benders  Decomposition  Algorithm  with  Heuristic:  Frank-Wolfe  Method 
Summary  of  Results,  Medium  Network.  Solving  the  network  interdiction  problem  on 
network  NM  using  the  Benders  decomposition  algorithm  with  the  Frank-Wolfe 
implementation  of  the  flow-dispersion  heuristic,  with  9  units  of  interdiction  resource,  takes 
12  iterations  of  the  algorithm,  8  minutes  and  53.6  seconds  of  solver  time,  and  1  hour,  23 
minutes,  and  4  seconds  of  clock  time.  This  is  less  than  30%  of  the  number  of  iterations  and 
less  than  3%  of  the  solver  time  required  to  solve  the  problem  with  Benders  decomposition 
alone.  No  comparison  is  made  for  the  test  case  where  R  =  12. 
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The  best  method  for  implementation  of  the  heuristic,  as  problems  become  larger, 
seems  to  be  the  many  level  approximation  method.  It  is  significantly  more  effective  for 
solving  the  larger,  harder  problems.  For  the  cases  studied,  the  number  of  iterations  of  the 
Benders  decomposition  is  significantly  less  for  this  method  compared  to  the  others,  about 
half  for  the  case  where  R=\2.  Similarly,  the  solver  time  required  for  the  many-level 
approximation  method  is  only  about  20%  of  either  the  two-level  iterative  approximation 
method  or  the  Frank-Wolfe  method.  An  exception  to  this  statement  is  the  case  where  R  = 
3  and  arc  interdiction  costs  are  varied,  where  the  Frank-Wolfe  method  is  the  most 
efficient.  The  two-level  iterative  approximation  method  is  also  competitive  when  resource 
levels  are  small.  If  the  many-level  approximation  method  is  indeed  the  best,  it  still  has  at 
least  one  drawback:  it  requires  a  larger  computer  memory  capacity  than  the  other 
methods. 

The  large  network  NL  is  analyzed  using  the  RISC/6000  and  the  many-level 
approximation  method.  The  results  for  network  NL  are  in  Table  10. 


LARGE 

NETWORK 

CASE(NL) 

NUMBER  OF 
BENDERS 
ITERATIONS 

TOTAL 

SOLVER 

TIME  (hr: min: sec) 

TOTAL 

CLOCK 

TIME(hr:min:  sec) 

12 

21 

00:36:57.3 

05:44:20 

Table  10.  Benders  Decomposition  Algorithm  with  Heuristic:  Many-Level 
Approximation  Method  Summary  of  Results,  Large  Network.  Solving  the  network 
interdiction  problem  on  network  NL  using  the  Benders  decomposition  algorithm  with  the 
many-level  approximation  implementation  of  the  flow-dispersion  heuristic,  with  12  units  of 
interdiction  resource,  takes  21  iterations  of  the  algorithm,  36  minutes  and  57.3  seconds  of 
solver  time,  and  5  hours,  44  minutes,  and  20  seconds  of  clock  time.  These  results  are  later 
compared  to  results  from  solving  this  problem  directly. 


The  advantage  of  the  many-level  approximation  method  is  made  clearer  from  the  results  in 
Table  10.  Only  21  iterations  of  the  algorithm  are  required  for  the  large  network, 
compared  with  3 1  and  28  iterations  to  solve  the  medium  network  using  the  two-level 
approximation  method  and  the  Frank-Wolfe  method,  respectively.  Comparison  of  solver 
and  clock  times  yield  similar  differences.  The  large  clock  time  in  Table  10  is  discouraging. 
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but  the  prototypical  nature  of  this  research  admits  such.  In  practical  application,  an 
efficient  compiled  high-level  computer  language  should  be  used  with  solvers  rather  than 
prototypic  GAMS,  which  is  easy  to  apply  but  painfully  slow  to  execute.  Also,  additional 
methods  beyond  the  scope  of  this  thesis  are  available  to  speed  up  solution  time  in  the  more 
time-consuming  Benders  master  program. 

The  many-level  implementation  of  the  heuristic  is  extended  to  accommodate 
directed  and  undirected  arcs  and  node  interdictions.  The  same  two  cases  are  studied, 
using  network  NS'  as  before.  The  results  are  displayed  in  Table  1 1 . 


SMALL 

NETWORK 

CASE(NS') 

BENDERS 

ITERATIONS 

HaiiM 

TOTAL 

CLOCK 

TIME(hr:min:  sec) 

NUMBER 

OF 

% 

OF 

SEC.  A 

TOTAL 

% 

OF 

SEC.  A 

R^3,  50% 
undirected  arcs 

5 

50% 

00:00:14.3 

188% 

00:06:03 

R  =  3,  100% 
undirected  arcs 

5 

50% 

00:00:15.6 

203% 

00:06:11 

Table  11.  Benders  Decomposition  Algorithm  with  Heuristic:  Many-Level 
Approximation  Method  Summary  of  Results,  Small  Network  with  Directed  and 
Undirected  Arcs,  Node  Interdictions  Allowed.  Solving  the  network  interdiction  problem 
on  network  NS'  using  the  Benders  decomposition  algorithm  with  the  many-level 
approximation  implementation  of  the  flow-dispersion  heuristic,  with  all  arcs  undirected  and 
3  units  of  interdiction  resource,  takes  5  iterations  of  the  algorithm,  15.6  seconds  of  solver 
time,  and  6  minutes  and  1 1  seconds  of  clock  time.  This  is  50%  of  the  number  of  iterations 
and  203%  of  the  solver  time  required  to  solve  the  problem  with  Benders  decomposition  alone. 

As  in  the  computations  of  Section  A,  where  the  heuristic  was  not  used,  the  computational 
effort  required  depends  very  little  on  the  number  of  undirected  versus  directed  arcs  in  this 
small  problem.  We  conjecture,  however,  that  this  might  not  be  the  case  when  solving  a 
large-scale  problem. 

Having  obtained  a  sufficient  sample  of  results  from  the  implementation  of  the 
Benders  decomposition  algorithm,  with  and  without  the  flow-dispersion  heuristic,  it  is 
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interesting  to  finally  compare  these  results  with  those  obtained  from  solving  the  network 
interdiction  problem  directly  with  model  IPl.  We  suspect  any  payoff  from  the 
decomposition  methods  shown  here  will  be  most  evident  when  solving  larger  problems. 
Therefore,  we  solve  the  =  12  case  with  IPl  and  present  the  results  in  Table  12.  The 
solver  terminated  prior  to  reaching  a  satisfactory  solution  due  to  exceeding  pre-set  time 
limits.  The  results  are  sufficient  to  clearly  demonstrate  that,  in  this  example,  the  Benders 
decomposition  algorithm  with  the  flow-dispersion  heuristic  provides  a  solution  more 
quickly  than  solving  the  integer  program  directly.  Comparing  Tables  10  and  12,  we  see 
that  we  achieve  at  least  a  68%  reduction  in  required  solver  time  over  the  direct  solution 
method.  We  do  not  compare  clock  times  because,  as  previously  stated,  they  include  the 
relatively  slow  operations  of  GAMS. 


LARGE 

NETWORK 

CASE(NL) 

TOTAL 

SOLVER 

TIME  (hr:min:sec) 

TOTAL 

CLOCK 

TIME(hr:min:sec) 

R=\2 

>01:57:59 

>03:09:27 

Table  12.  Integer  Programming  Summary  of  Results,  Large  Network.  Solving  the 
network  interdiction  problem  on  network  NL  directly  using  integer  programming  model  IPl, 
with  12  units  of  interdiction  resource,  takes  more  than  1  hour,  57  minutes,  and  59  seconds 
of  solver  time,  and  more  than  3  hours,  9  minutes,  and  27  seconds  of  clock  time.  The  same 
problem  is  solved  in  less  than  68%  of  this  solver  time  using  Benders  decomposition  with  the 
many-level  approximation  implementation  of  the  heuristic,  as  shown  in  Table  10. 
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m.  NETWORK  INTERDICTION  OF  PROBABILISTIC  SCENARIOS 


Some  degree  of  uncertainty  is  likely  in  network  interdiction  problems.  Only  the 
most  intensely  studied  or  simplest  drug  transportation  networks  will  be  known  in  sufficient 
detail  for  a  planner  to  be  confident  that  the  best  interdiction  sites  can  be  selected  using 
(only)  deterministic  methods.  More  likely,  there  will  be  varying  degrees  of  uncertainty 
associated  with  arc  capacities,  node  capacities,  the  very  existence  of  network  components, 
and  the  success  of  each  interdiction  attempt. 

Unfortunately,  the  complexity  of  this  problem  can  be  overwhelming.  For  example, 
consider  the  case  of  each  arc  having  only  two  possible  values  of  capacity.  If  arc  capacities 
are  probabilistically  independent,  then  there  are  2^'  realizations  of  this  network  to  analyze 
for  the  optimal  interdiction  set.  For  all  but  the  smallest  network,  this  problem  is 
intractable  using  standard  methods.  If,  however,  a  relatively  small  set  of  the  most  likely 
instances  of  the  network  can  be  constructed  and  probabilities  ascribed  to  these  instances, 
the  problem  may  be  readily  solved. 

This  chapter  explores  an  application  of  the  L-shaped  algorithm  (Van  Slyke  and 
Wets,  1969)  to  the  stochastic  network  interdiction  problem  and  gives  examples  of 
computations.  For  additional  information  on  general  stochastic  programming  techniques, 
the  interested  reader  is  referred  to  Kali  and  Wallace  (1994). 

A.  INTEGER  PROGRAMMING  METHOD 

Suppose  the  capacity  of  each  component  in  a  network  is  a  discrete  random 
variable.  This  includes  situations  where  there  is  a  non-zero  probability  that  an  arc  in  the 
mathematical  network  model  may  not  actually  exist  in  the  real  network.  Such  a 
"nonexistent"  arc  is  treated  as  an  actual  arc  with  zero  capacity.  If  this  sort  of  uncertainty 
is  present,  a  set  of  "scenarios"  may  be  constructed,  where  each  scenario  is  one  realization 
of  the  network  in  which  exactly  one  instance  of  each  probabilistic  arc  in  the  network  is 
selected.  By  enumeration  of  all  scenarios,  the  interdiction  decision  can  be  made  in  an 
optimal  manner  over  all  possible  network  realizations.  The  interdictor's  objective  is  to 
minimize  the  expected  value  of  the  adversary's  maximum  flow. 
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1.  Model 

In  this  model,  the  capacities  of  some  or  all  of  the  arcs  are  discrete  random 
variables,  possibly  dependent.  A  manageable  number  of  scenarios  v  e  F  is  established, 
each  occurring  with  a  probability  that  describes  the  possible  outcomes  of  the  random 
variables.  For  illustration,  suppose  three  separate  law  enforcement  or  anti-drug  agencies 
have  constructed  three  differing  estimates  of  monthly  cocaine  traffic  being  transported 
from  Jamaica  to  Nassau  by  air.  The  first  two  agencies  estimate  10kg  and  20kg, 
respectively.  The  third  agency,  though,  believes  this  particular  air  route  is  not  used  for 
drug  trafficking,  i.e.,  0kg  of  monthly  cocaine  traffic  (a  nonexistent  arc).  Confidence  in 
these  estimates  is  ranked  and  probabilities  are  assigned  in  accordance  with  the  confidence 
ranking,  the  higher  the  confidence  the  higher  the  probability  assignment.  Thus  the 
probabilities of  0.35,  0.40,  and  0.25  might  be  assigned  to  weight  the  estimates, 
respectively.  Note  that  in  each  of  the  three  scenarios  in  this  example,  only  the  Jamaica  - 
Nassau  link  is  addressed;  the  remainder  of  the  network  must  be  identical  between 
scenarios  to  allow  a  proper  assignment  of  probabilities. 

Let  be  the  flow  on  arc  {ij)  in  scenario  v,  and  let  be  the  corresponding  arc 
capacity.  A  stochastic  network  interdiction  model  with  |  F]  scenarios  is 


min 

yer 


{  E  />.  max  x„  } 

V  e  F  X 


where 


Y'  X .  -Y  ^  =0 

Z-— ^  SJV  JSV  tsv 

J  J 

/  J 

V  X .  -  T  X  .,  ^  X  =  0 

(jfv  jtv  tsv 

J  J 

^  ^  V  ^  1  )  V  (iJ)eA 
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and  r  =  {  y.. :  e  {0,1 }  V  {ij)  e  A ,  ^  R}.  This  model  is  simply  an 

extension  to  the  one-scenario  (deterministic)  model  of  Wood.  Fixing  and  taking  the 
dual  of  the  inner  maximization  yields 


Using  an  argument  analogous  to  that  of  Wood,  the  constraints  ^  +  y,-,  -  0,^^  ^  0  may 

be  replaced  with  equalities  ^  +  y  -  0.^  =  0  which  allows  6.^  to  be  replaced  by 

^ijv*  ij-  The  interdiction  set  r  is  now  stated  explicitly  as  a  constraint,  yielding  the 
final  model; 
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IPV  min  F  P  p  .. 

o  ^  ^  V  m  ^  ijv 

“jPjY  v€V  (iJ)e.A 


S.t. 


y  r.Y^  £  R 

^  ij  '  ij 

a,  -  a.  +  p.+Y  ^0  V  (iJ)eA 

IV  jv  ^  iw  ‘  i;  \  if/ 


IJV 

-  a  ^  1 

tv  sv 


^  y  ieN 

P.,,Y,;,  €  {0,1}  V  (iJ)eA 


>  V  veV. 


Interpretation  of  variables  in  IPV  is  the  same  within  each  scenario  as  for  the  case  where 
1  F|  =  1,  presented  earlier  as  model  IPl. 

A  potential  limitation  of  EPV  is  the  very  large  number  of  constraints  required  for  a 
problem  with  many  scenarios.  The  computational  difficulties  imposed  by  an  very  large 
integer  program  invites  the  use  of  decomposition  methods  of  the  previous  chapter  for  this 
multi-scenario  situation.  We  will  first,  however,  examine  direct  solution  of  model  IPV. 

2.  Computational  Results 

A  five-scenario  example  is  constructed  and  solved  using  network  NM  and  the 
branch-and-bound  implementation  in  GAMS/XA.  This  test  case  confirms  that  this  is  an 
inefficient  technique  for  larger  networks  with  many  scenarios;  it  fails  to  exploit  the  special 
structure  of  the  problem.  The  results  are  in  Table  13.  As  in  the  one-scenario  integer 
programming  case  tested  in  Section  II. 2  (Table  12),  the  solver  terminated  prior  to 
reaching  a  satisfactory  solution  due  to  exceeding  pre-set  time  limits.  These  results  will  be 
compared  against  the  Benders  decomposition  approach,  analyzed  in  the  next  section. 
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MEDIUM 

NETWORK 

CASE(NM) 

TOTAL 

SOLVER 

TIME  (hr;min;sec) 

TOTAL 

CLOCK 

TIME(hr  :min:  sec) 

R  =  3 

>  00:47:03 

>01:12:28 

Table  13.  Integer  Programming  for  Five  Scenarios  Summary  of  Results,  Medium 
Network.  Solving  the  network  interdiction  problem  for  five  scenarios  on  network  NM 
directly  using  integer  programming  model  EPV,  with  3  units  of  interdiction  resource,  takes 
more  than  47  minutes  and  3  seconds  of  solver  time,  and  more  than  1  hour,  12  minutes,  and 
28  seconds  of  clock  time.  These  results  are  later  compared  to  results  from  solving  the  five- 
scenario  problem  with  the  L-shaped  algorithm. 

B.  BENDERS  DECOMPOSITION:  THE  L-SHAPED  ALGORITHM 

In  the  same  manner  as  the  one-scenario  case,  an  equivalent  formulation  is  derived 
fi'om  the  original  integer  program  that  suggests  a  Benders  decomposition  algorithm.  The 
final  decomposed  model  and  computational  results  are  then  presented. 

1.  Model 

Proceeding  as  before,  if  y  is  fixed,  the  LP  relaxation  of  IPV  is  the  dual  of  a 
network  flow  problem  with  an  intrinsically  integer  solution.  The  dual  is  taken  with  respect 
to  a  and  P  and  the  resource  constraint  is  again  represented  as  an  interdiction  set  F.  The 
model  becomes 


min  max  ^  x 

-  V  V  Y  ^ 

tsv  Zm^  Z^  *  ijv 

Y  ^  ^  ^  V  e  K 

V€  K  iiJ)eA 

S.t.  V  ^ 

sjv 

-  X.  -  X,  =0 

Z^  jsv  tsv 

J 

J 

Tx..  y  X.  =  0 

ijV  Zm^  jiv 

J  J 

V  X  -  V  x  +  X  =  0 

jtv  tsv 

J 

J 

0  ^  X  ^  p 

IJV  ^  V 

y  i  eN  - 


V  V  €  F. 


Now,  as  before,  we  enumerate  all  the  extreme  point  solutions  of  the  inner  maximization 
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and  then  select  that  solution  with  maximum  value  subject  to  y  e  T .  The  Benders  master 
problem  becomes 


min  ^ 

Y  eF 

St  t  ^  -  E  E  4'ii,  vac*€X' 

ver  v^V{ij)tA 

y.  6  {0,1}  y{iJ)eA 

where  X  is  the  set  of  all  extreme  point  solutions  jc*  and  X'q  X.  With  fixed  at  0  or  1, 
the  Benders  subproblem  for  the  multi-scenario  case  is 


The  objective  fimction  of  the  subproblem  may  be  rewritten  as 

max  E  -  E 

X  veV  (ij)tA 

and  the  constraints  may  be  separated  into  |  V\  independent  maximizations,  each 
representative  of  a  different  scenario.  The  objective  function  value  of  the  complete 
subproblem  is  then  obtained  by  sununing  over  all  the  scenarios.  Therefore,  the  flow 
variables  returned  to  the  master  problem  as  extreme  point  solutions  are  sums  of  the 
flows  in  each  arc  (ij)  over  all  the  scenarios.  The  master  problem  simplifies  to 
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min  z 

Y  eP 

s.t.  z  ^  -  y]  y..x’^. 

tS  ^  *  1) 

H-S)f.A 

Yij  e  {0,1}  V  (iJ)eA 

where  x^^  =  x^^  and  x^.  =  ^2  .  Equivalently,  the  arc  capacity  constraint  in  the 

V  €  K  V  e  K 

subproblem  can  be  replaced  by 

®  ^  V  ^  V  V(/V)e^ 

in  each  scenario  v.  The  probability  of  the  occurrence  of  each  scenario,  p^,  is  taken  into 
account  in  the  aggregation  of  scenarios:  x^^  =  Pv^tjv 

Y  C  V  E  V 

Regardless  of  method,  the  flow  values  returned  to  the  master  problem  as  cuts  (constraints) 
are  the  expected  values  of  flow  on  each  arc,  observed  over  all  scenarios.  Therefore,  each 
iteration  of  the  algorithm  requires  the  solution  of  one  master  problem  and  \  V\  subproblems. 
The  arc  flows  computed  in  the  subproblems  are  combined  in  a  sum  weighted  by  prior  to 
the  next  iteration  of  the  master  problem. 

To  summarize  this  procedure,  we  display  the  algorithm  below.  As  before,  let  z(J) 
denote  the  optimal  value  of  the  objective  function  to  the  optimization  problem/ 


The  L-Shaped  Algorithm  for  Network  Interdiction 

Input:  Network  G=(A(y4),  arc  interdiction  costs  interdiction  budget  R, 
special  nodes  s  and  /,  convergence  tolerance  toler,  and  for  each 
scenario  v.  probability  of  occurrence  p^  and  arc  capacities 
Output: Interdiction  vector  Y*,  which  is  the  solution  within  (100  •  toler)% 
of  optimality. 

stepl  Letw  ; 

V  €  F 

Solve  maximum  flow  problem  MF  for  flow  values 
Let^'=  {x^}- 
Let  k  =  2; 
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LetUB=z(MF) 


step  2  Solve  MASTERCX)  for  ^ ; 

Let  LB  =  2  (MASTER(X^) 

step  3  For  v  ==  1  to  L 

Solve  SUB^(  ^  )  for 
next  v; 

Calculate  Pv^v’ 

ve  V 

LetX'  =  X'[J{x’'}; 

Calculate  z(SUB)  =  ^  /?  z(SUB 

veV 

If  z(SUB)  <  UB  then  let  UB  =  z(SUB)  and  Y  ^ 

step  4  If  UB  -  LB  ^  LB  •  toler  then  stop:  Interdiction  set 

Y  *  is  a  solution  to  the  network  interdiction  problem  with 
objective  function  value  within  (100  •  toler)%  of  the  optimal 
objective  function  value. 

step  5  Let  k  =  k  +  1; 

Go  to  step  2. 


Note  that  the  upper  bound  obtained  in  step  1  is  valid  due  to  Jensen's  inequality  (e.g..  Kali 
and  Wallace,  1994,  p.  168),  although  it  may  not  be  a  strong  bound  since  there  are  no 
interdictions. 

2.  Computational  Results 

The  same  five-scenario  example  from  Section  A  is  analyzed  here.  The  results  are 
presented  in  Table  14.  Comparing  the  direct  integer  programming  results  in  Table  13  and 
the  L-shaped  algorithm  results  in  Table  14,  the  advantages  of  decomposition  are  clear. 
Here,  we  achieve  at  least  a  93%  reduction  in  required  solver  time  over  the  direct  solution 
method.  As  the  number  of  scenarios,  network  size,  and  resource  budget  grows,  the 
possible  advantages  of  a  decomposition  approach  become  more  apparent.  This  result  is 
paralleled  earlier  for  the  one-scenario  case  in  Section  B.2  of  Chapter  11.  Again,  clock 
times  are  not  compared  here  due  to  the  relatively  slow  operations  of  GAMS. 
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MEDIUM 

NETWORK 

CASE(NM) 

NUMBER  OF 
ALGORITHM 
ITERATIONS 

TOTAL 

SOLVER 

TIME  (hr:min;sec) 

TOTAL 

CLOCK 

TIME(hr:min:  sec) 

R  =  3 

13 

00:02:57.2 

00:17:15 

Table  14.  L-Shaped  Algorithm  for  Five  Scenarios,  Summary  of  Results,  Medium 
Network.  Solving  the  network  interdiction  problem  for  five  scenarios  on  network  NM  using 
the  L-shaped  algorithm,  with  3  units  of  interdiction  resource,  takes  13  iterations  of  the 
algorithm,  2  minutes  and  57.2  seconds  of  solver  time,  and  17  minutes  and  15  seconds  of  clock 
time.  The  solver  time  is  a  reduction  of  at  least  93%  over  the  solver  time  required  to  solve  the 
five  scenario  problem  directly  with  integer  programming,  as  shown  in  Table  13. 
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IV.  STOCHASTIC  NETWORK  INTERDICTION 

The  multi-scenario  approach  of  the  previous  chapter  is  adequate  when  the  number 
of  scenarios  is  limited.  If  uncertainty  is  prevalent  in  the  network  or  the  assumption  of 
dependency  between  arc  capacities  is  not  valid,  more  efficient  means  are  available  to  arrive 
at  a  solution.  In  this  chapter,  a  unique  algorithm  is  used  for  computations.  The  results  are 
compared  to  those  of  the  deterministic  models. 

A.  A  SEQUENTIAL-APPROXIMATION  ALGORITHM 

In  this  chapter,  a  proposition  is  stated  that  aids  in  the  derivation  of  the  stochastic 
network  interdiction  problem.  An  algorithm  is  presented  that  efficiently  solves  the  two- 
stage  stochastic  program  with  recourse.  Two  example  problems  are  solved  and  discussed. 

1.  Development 

Consider  a  network  with  a  special  subset  of  arcs  A'  ^  A  .  If  the  arcs  in  A  * 
have  been  interdicted,  evaluating  the  maximum  flow  in  the  "residual  network"  can  be  done 
by  solving  Ml : 

Ml  max  X 

X 

s.t.  v  ^  X.  -  x=  0 

Sj  JS  ts 

J  J 

E  -  E  0  V  /  6  W"  -  {a:,/} 

J  j 

Y^x-Y.  ^  v  +  X  =  0 

^  jt  ts 

J  J 

0  ^  X.,  ^  V  (iJ)eA 
X..  ^  0  V  (ij)  eA’. 

The  determination  of  the  set  A  *  is  exogenous  to  Ml.  In  the  development  of  the  Benders 
decomposition  model  in  Chapter  II,  it  was  shown  how  SUB(  ^  )  solves  the  network 
interdiction  problem  with  ^  =  y*.  Model  M2,  below,  is  a  generalized  version  of  SUB(  ^ ) 
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which  has  a  modified  objective  function  that  penalizes  an  arc's  membership  in  the  set  A”: 


M2 


max 

X 

-  E 

X. 

y 

S.t 

E  -  E 

X  -  x  = 

JS  t$ 

J  J 

V  X.. 

^  V 

II 

1 

J 

J 

X.^  +  X  = 
jt  ts 

J  J 

0  ^  X  ^ 

V  ‘J 


Proposition  \  :  Models  Ml  and  M2  yield  equal  objective  function  values:  z(MJ)  = 
z(M2). 


Although  the  flow  values  jc  will  not  necessarily  be  the  same  in  optimal  solutions  to  Ml  and 
M2,  this  is  not  important.  From  the  viewpoint  of  the  interdictor,  the  most  significant 
information  to  be  gained  fi'om  solving  the  network  interdiction  problem  is  the  interdiction 
sites,  y. 

Proposition  1,  as  we  shall  show,  facilitates  the  development  of  a  stochastic 
network  interdiction  algorithm. 

2.  Stochastic  Models 

In  an  uncertain  environment,  a  network  interdiction  attempt  may  be  completely 
successful,  partially  successful,  or  unsuccessful.  We  consider  only  the  binary  case  where 
an  attempted  interdiction  of  arc  (y)  is  completely  successful  with  probability  p^,  and 
completely  unsuccessful  with  probability  1  -  p^. 

Let  ly  be  an  indicator  random  variable  that  is  1  with  probability  Py  and  is  0  with 
probability  1  -  Py.  The  vector  of  indicator  variables  I  has  state  space  J  =  {0,1 For 
binary,  random,  interdiction  success,  the  following  min-max  model  is  the  stochastic  analog 
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of  model  MINMAX: 


S  - 1  w  *  =  min  Eh  (y,I) 

yer 

where 


/j(Y,I)  =  nm 

s.t.  ^  X  .  -  X.  -x=0 

^  SJ  JS  tS 

J  J 

E^-E^y, -0  VieN-{s,,) 

J  / 

E  -  E  ’‘j,  •*„■<) 

/  J 

0  ^  X..  ^  «..(1  -  /„yP 

Now  using  Proposition  1,  S-1  can  be  reformulated  as 

S-2  w’  =  min  £g'(Y,I) 

yer 

where 


^(Y,I)  =  max  x,^  -  V  I  y  x 

^  ^  ‘  ^  y  ts  ij  ‘  ij  IJ 

s.t.  X  .  -  V  X  -  X  =  0 

SJ  Z-/  JS  ts 
J  J 

/  J 

E  ^  -  E  ”‘«-o 

J  j 

0  i  X.  i  u..  V  {iJ)eA. 
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and  g{y,t)  =  h(y,l)  for  all  {y,l)  e  {0,1 x  J  .  in  this  application,  the  set  A  *  is  defined 
as  A*  =  {  (ij)  e  A  \  y ^  \ =  1  }  .  Models  S-1  and  S-2  allow  us  to  develop 
upper  and  lower  bounds  on  w  ‘with  the  use  of  Proposition  2,  below. 

Proposition  2;  For  fixed  y,  ^(y,j?)  and  h(y,T)  are  convex  and  concave  functions  on  the 
convex  hull  ofJ,  respectively. 

Letting  I  $=  £7^  and  applying  Jensen's  inequality  twice  we  obtain 

^(Y,I)  ^  Eg{y,l)  =  EhiyX)  <. 

Bounds  on  w  ‘may  be  obtained  by  solving  min^  ^  p ^(Y,I)to  obtain  y ,  producing; 

g(9,I)  ^  w‘  ^ 

In  the  algorithm,  we  use  these  bounds  extended  to  a  partition  of  the  state  space  of  the 
indicator  random  variables.  Let  S  =  be  such  a  partition  of  J.  Members  of  S 

are  referred  to  as  "cells."  If  I*=  £(I|I  e J*‘)  and =  Prob(I  e J‘‘),  then  a  lower  bound  on 
w  ‘with  respect  to  the  partition  S  is 

K  _ 

w‘  ^  L(S)  =  min  53  7^ 

Y  jt.  1 

The  upper  bound  associated  with  a  fixed  first  stage  decision  vector  y  is 

K 

W  s  U(S,f)  .  £  p‘A(Y,i‘). 

k  -  1 

This  upper  bound  is  most  easily  found  by  applying  the  optimal  decision  y  obtained  during 
the  calculation  of  L(S).  Alternately,  it  is  possible  to  calculate  the  least  upper  bound,  with 
respect  to  partition  S,  by  solving  min^  e  r  ^ ■ 
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3.  Algorithm 

The  algorithm  is  a  sequential-approximation  method  that  utilizes  the  bounds 
developed  in  Section  2.  Its  design  and  implementation  are  described  in  more  detail  in 
Cormican,  Morton,  and  Wood  (1995). 


Sequential-Approximation  Algorithm 

Input;  Network  G=(N,A),  arc  capacities  u^j,  arc  interdiction  costs  r^, 

interdiction  budget  R,  special  nodes  s  and  t,  probabilities  of  interdiction 
success  Py,  convergence  tolerance  toler. 

Output:Interdiction  vector  y* approximately  solving  S-1,  lower  bound  and 
upper  bound  U*  on  w*  such  that  L*  ^  Eh  ^  U*  and 

U*-L*  staler. 

step  1  Let5'={J},  C/*  = +00  ^ =  0 

step  2  Calculate  Z*  =  LiS)  and  associated  minimizer  ^ ; 

Calculate  t/'=  U{S,^) 

step  3  l^U'<  U*,  let  U*  =  U'  and  let  y*=  ^ 

step  4  lfU*-L*<  toler,  then  stop;  Approximate  solution  is  y* 

step  5  Refine  the  partition  5; 

Go  to  step  2. 

In  this  algorithm,  step  1  establishes  the  initial  partition  and  sets  bounds.  The  upper 
bound  is  directly  determined  in  step  2,  while  the  lower  bound  may  be  found  either  directly 
or  with  Benders  decomposition.  Step  3  updates  the  upper  bound,  if  needed,  and  saves  the 
solution  associated  with  the  best  upper  bound.  Step  4  terminates  the  algorithm  if 
convergence  criteria  have  been  met. 

The  partition  refinement  of  step  5  is  a  procedure  that  selects  and  subdivides  a  cell 
from  the  partition  S.  The  cell  for  selection  is  determined  by  first  noting  that  the  gap 
between  the  upper  and  lower  bounds  is 


K 

-  US).  5:  /-'[AWT)  - 


k  -  1 
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with  a  difference  due  to  each  cell  of 


We  select  a  cell  k'  to  subdivide  such  that  D  =  max^  although  other 

selection  criteria  could  be  used. 

The  refinement  of  partitions  in  the  selected  cell  uses  a  method  analogous  to  that 
presented  by  Kail  et  al.  (1988),  by  conditioning  on  whether  or  not  an  attempted 
interdiction  is  successful.  Cormican,  Morton,  and  Wood  (1995)  further  explains  this  and 
other  types  of  partitioning,  as  well  as  more  details  on  the  specifics  of  the  algorithm  and 
alternate  implementations  of  various  steps  of  the  algorithm. 

4.  Computational  Results 

Two  cases  are  tested  using  OSL  on  the  RISC/6000.  The  selected  network  is  NS, 
with  R  =  (3,  6)  and  all  other  characteristics  as  stated  in  Table  2.  In  these  tests,  an 
interdiction  attempt  is  equally  likely  to  be  a  success  or  failure,  as  p^j  =  0.5  V  (/j)  e  A  . 
The  time  results  are  in  Table  15.  Since  this  algorithm  does  not  use  GAMS,  only  the  total 
clock  time  is  listed.  The  most  logical  comparison  of  these  times  with  those  of  previous 
techniques  is  to  use  the  solver  times  of  those  methods. 


SMALL 

NETWORK 

CASE(NS) 

NUMBER  OF 
ALGORITHM 
ITERATIONS 

TOTAL 

CLOCK 

TIME(hr:min:  sec) 

y?  =  3 

8 

00:00:23.6 

R  =  6 

31 

00:24:35.3 

Table  15.  Sequential-Approximation  Algorithm  Summary  of  Results,  Small  Network. 

Solving  the  network  interdiction  problem  on  network  NS  using  the  sequential-approximation 
algorithm,  with  6  units  of  interdiction  resource,  takes  3 1  iterations  of  the  algorithm  and  24 
minutes  and  35.3  seconds  of  solver  time. 

Although  the  actual  arcs  interdicted  are  not  the  focus  of  this  research,  it  is 
interesting  to  note  that  when  /?  =  3,  one  of  interdicted  arcs  was  different  than  those 
interdicted  in  the  deterministic  model.  When  R-6,  again,  one  interdicted  arc  was 
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different. 

Comparing  the  expected  value  solutions  (i.e.,  all  interdictions  result  in  a  50% 
reduction  in  flow)  is  also  interesting.  This  corresponds  to  the  network  interdictor 
measuring  the  capability  of  this  network  to  carry  flow  by  solving  the  problem  in  which  all 
stochastic  parameters  are  replaced  by  their  expected  values.  Having  done  this,  he  would 
calculate  a  maximum  flow  of  165  for  the  R  =  3  case.  From  Jensen's  inequality  applied  to 
S-1,  this  is  known  to  overestimate  the  true  value  of  expected  maximum  flow.  This  true 
value,  solved  (optimally,  in  this  case)  by  the  algorithm,  is  162.5.  For  the  i?  =  6  example, 
the  numbers  to  compare  are  a  mean- value  problem  flow  of  180  and  an  actual  flow  of  130. 
The  general  trend  is  that  as  the  number  of  interdiction  resources  increases,  there  is  an 
increasing  error  between  these  two  values.  Therefore,  the  advantages  from  using  this 
algorithm  are  best  seen  when  the  resource  budget  is  large. 

Another  benefit  of  using  this  algorithm  is  its  adaptability  to  other  forms  of 
uncertainty.  Although  beyond  the  scope  of  this  thesis,  it  is  possible  to  use  a  variation  of 
this  algorithm  to  analyze  stochastic  network  interdiction  problems  with  arc  capacities  as 
discrete  random  variables,  and  cases  where  both  interdiction  attempts  and  arc  capacities 
are  uncertainties.  These  additional  capabilities  are  demonstrated  in  Cormican,  Morton, 
and  Wood  (1995). 
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V.  CONCLUSION 


This  chapter  describes  both  the  successful  and  not-so-successful  aspects  of  the 
models  presented  in  this  thesis.  Ideas  for  further  model  development  and  computational 
improvements  are  noted. 

A.  GENERAL  RESULTS  OF  MODELS 

This  thesis  has  successfully  solved  the  network  interdiction  problem  with  models 
that  are  applicable  to  almost  any  network  type  and  topology.  All  models  are  easily 
generalized  to  accommodate  almost  any  situation.  These  models  allow: 

•  non-planar  networks, 

•  any  number  of  source  and/or  sink  nodes, 

•  any  location  of  source  and/or  sink  nodes, 

•  directed  (only),  undirected  (only),  or  both  directed  and  undirected  arcs, 

•  differing  costs  of  interdiction  of  network  components, 

•  arc  and/or  node  interdictions, 

•  placing  certain  arcs  and/or  nodes  "off  limits"  for  interdiction, 

•  arc  capacities  as  discrete  random  variables  in  scenarios,  and 

•  interdiction  attempts  as  independent,  probabilistic  events. 

These  features  allow  much  greater  flexibility  in  modelling  than  most  previous 
methodologies. 

The  network  interdiction  problem  can  be  solved  effectively  using  the  techniques  of 
Benders  decomposition.  The  possible  benefits  of  using  Benders  decomposition  over  direct 
integer  programming  include  reducing  the  time  required  to  solve  large  problems,  and  the 
iterative  nature  of  the  solution  allows  the  observation  of  both  worst-case  and  best-case 
outcomes  as  the  solution  progresses.  If  the  solution  is  only  required  to  be  "good,"  rather 
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than  "the  best,"  the  methods  in  this  thesis  are  ideal. 

The  appeal  of  the  Benders  decomposition  algorithm  is  clear  if  we  think  of  the 
network  interdiction  problem  as  an  adversarial  relationship  between  the  network 
interdictor  and  the  network  user.  First,  the  network  user  maximizes  the  flow  of  a 
commodity  in  the  network.  The  network  interdictor  observes  this  activity,  selects 
interdiction  sites,  and  expends  his  interdiction  budget  to  minimize  the  network  user's 
maximum  flow.  The  network  user  reorganizes  in  the  wake  of  these  interdictions,  and 
again  maximizes  flow  on  the  remaining  network.  This  process  repeats,  until  neither 
participant  can  do  any  better:  an  equilibrium  has  been  reached. 

The  character  of  this  solution  results  in  the  intuitively  appealing  flow  dispersion 
heuristic.  Dramatic  reductions  in  the  number  of  Benders  decomposition  algorithm 
iterations  are  observed  when  the  heuristic  is  used.  Three  different  implementations  of  the 
heuristic  are  tried,  with  the  many-level  approximation  method  seeming  to  be  the  most 
efficient.  In  one  instance,  this  method  decreases  the  required  algorithm  iterations  by  over 
80%  and  lowers  the  clock  time  required  for  a  solution  by  a  factor  of  over  100.  In  another 
example,  this  method  outperforms  the  direct  integer  programming  method  by  using  less 
than  one-third  of  direct  method's  solver  time. 

B.  RESULTS  FROM  MODELS  WITH  UNCERTAINTY 

This  thesis  is  the  first  work  on  network  interdiction  that  applies  various  aspects  of 
uncertainty  in  a  quantitative  fashion.  In  practice,  very  few  network  interdiction  problems 
will  be  free  of  all  uncertainty.  Two  types  of  stochastic  programming  algorithms  are 
analyzed;  network  scenarios  using  the  L-shaped  algorithm,  and  a  more  flexible  sequential- 
approximation  algorithm.  Each  algorithm  has  been  used  to  investigate  a  different 
manifestation  of  uncertainty. 

The  capacities  of  arcs  and  nodes,  and  the  existence  (or  non-existence)  of  arcs  and 
nodes  are  likely  candidates  for  modelling  as  random  variables.  The  most  straightforward 
approach  is  to  construct  a  set  of  scenarios  of  network  capacities  and  topologies  and  assign 
to  each  scenario  an  estimated  probability  of  occurrence.  This  has  been  successfully 
accomplished,  but  the  rapidly  increasing  size  of  a  problem  with  many  scenarios  limits  the 
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usefulness  of  this  technique. 

The  sequential-approximation  algorithm  avoids  the  need  to  limit  the  number  of 
scenarios.  It  also  allows  uncertainty  to  exist  in  interdiction  success  and  will  soon  be 
adapted  to  analyze  networks  with  uncertain  arc  and  node  capacities.  Insights  have  been 
gained  into  the  advantages  and  disadvantages  of  this  approach. 

C.  POSSIBLE  MODEL  WEAKNESSES 

Having  espoused  the  mathematical  programming  approach,  it  must  also  be 
recognized  that  there  is  a  cost  to  including  all  the  benefits  listed  in  Section  A.  First  of  all, 
in  very  few  cases  will  an  mathematical  programming  approach  be  as  fast  as  an  approach 
using  algorithms  specific  to  solving  network  problems,  as  presented  in  Phillips  (1992),  for 
example.  On  the  other  hand,  a  "network  algorithm"  will  not  be  as  generalizable  and 
adaptable  as  the  models  in  this  thesis. 

There  are  benefits  to  solving  the  network  interdiction  problem  using  Benders 
decomposition  instead  of  direct  integer  programming,  but  they  may  be  difficult  to 
quantify.  The  "crossover  point,"  where  Benders  decomposition  becomes  the  better 
alternative,  is  not  obvious.  In  the  smaller  problems,  the  integer  program  will  most  likely 
arrive  at  a  solution  more  quickly  than  the  Benders  decomposition  algorithm.  Other  than 
the  compelling  evidence  in  Tables  10,  12,  13  and  14,  time  did  not  allow  an  in-depth  study 
to  determine  the  exact  point  where  the  Benders  decomposition  algorithm  becomes 
preferred  over  direct  integer  programming.  The  next  step  to  such  a  determination  would 
be  to  divorce  the  computations  from  the  time-consuming  manipulations  of  GAMS,  since 
the  Benders  decomposition  model  must  generate  many  formulations  to  solve  each  network 
interdiction  problem. 

The  performance  of  Benders  decomposition  improves  markedly  with  the  inclusion 
of  the  flow  dispersion  heuristic.  Unfortunately,  the  best  heuristic  technique  requires  the 
number  of  arcs  in  the  network  to  be  increased  ten-fold,  demanding  a  large  amount  of 
computer  memory  if  the  network  is  large.  If  the  extra  memory  is  not  available,  the 
heuristic  could  be  used  with  a  less  effective  implementation. 

Many  areas  of  this  research  would  be  supported  with  further  investigation  into  the 
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following  subjects. 


•  algorithms  implemented  in  an  efficient,  compiled,  high-level  computer  language, 

•  more  extensive  comparisons  of  Benders  decomposition  and  direct  integer 
programming  methods  for  large  and  very  large  networks, 

•  decreasing  the  time  needed  to  solve  the  Benders  master  problem, 

•  quantifying  the  effect  of  the  flow-dispersion  heuristic  on  algorithm 
convergence,  and 

•  using  simplicial  decomposition  to  implement  the  flow-dispersion  heuristic. 
Possible  areas  of  related  further  research  may  be: 

•  incorporating  various  probability  distributions  of  both  arc  and  node  capacity 
and  interdiction  success  into  the  sequential-approximation  algorithm, 

•  investigating  the  effects  of  time  during  a  prolonged  network  interdiction 
campaign, 

•  investigating  the  reconstitution  of  arcs  and  nodes  after  each  successful 
interdiction, 

•  how  to  obtain  the  best  estimates  of  arc  and  node  capacities  for  various 
applications,  and 

•  applying  Benders  decomposition  techniques  to  an  interdiction  problem  with 
more  general,  non-network  constraints. 

D.  CONCLUSIONS 

The  models  and  techniques  presented  in  this  thesis  could  provide  effective 
anal3dical  tools  to  planners  confronted  with  a  network-using  adversary.  It  is  hoped  that 
these  methods  provide  enough  variety  to  allow  planners  to  choose  the  one  most  suited  to 
their  purposes.  Whether  implemented  in  GAMS  or  other  high-level  computer  language, 
these  algorithms  are  highly  transportable  and  solvable  on  most  computers.  If  it  is  desired 
to  solve  large-scale  network  interdiction  problems,  or  problems  with  a  large  number  of 
stochastic  parameters,  the  use  of  a  PC  becomes  somewhat  impractical  and  a  more  capable 
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machine  should  be  used  to  achieve  an  acceptable  solution  time. 

Although  centered  on  the  efforts  to  stem  the  flow  of  illegal  drugs  into  the  United 
States,  the  possible  applications  of  these  techniques  are  as  numerous  as  networks 
themselves  are  numerous. 
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